Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.
Experience- 5-7 years
Location- Kochi, Chennai, Coimbatore, Pune, Mumbai
Job Overview
We are currently seeking experienced Data Engineers (5–7 years of experience) with strong expertise in Databricks, PySpark, and Data Fabric concepts to contribute to an ongoing enterprise data transformation initiative. The ideal candidates will have solid hands-on engineering skills, a good understanding of modern data architectures, and the ability to work collaboratively within cross-functional teams.
Key capabilities and expectations include:
- Strong experience in understanding and translating data transformation logic written in T- SQL and implementing equivalent, efficient transformations in Databricks using PySpark, aligned with Data Fabric design principles.
- Hands-on experience in designing and implementing data ingestion pipelines using Azure Data Factory, enabling reliable data movement from source systems to the RAW and curated data layers within a Data Fabric ecosystem.
- Working knowledge of Data Fabric concepts, including metadata-driven pipelines, data integration, orchestration, data lineage, and governance, with the ability to apply these principles in day-to-day engineering tasks.
- Experience in monitoring, collecting, and analyzing pipeline performance metrics to identify inefficiencies and support optimization of data ingestion and processing workflows.
- Practical experience in performance tuning and optimization of Databricks read and write operations, including partitioning, file formats, and query optimization techniques.
- Ability to collaborate closely with senior engineers and architects, contribute to design discussions, follow best practices, and support the continuous improvement of the data
- Strong problem-solving skills, eagerness to learn, and the ability to work effectively with cross
functional teams, including data analysts, data scientists, and business stakeholders.
This role is ideal for professionals looking to deepen their expertise in Databricks and Data Fabric architectures while contributing to scalable, well-governed, and high-performance enterprise data solutions.
What We Offer
- A competitive salary and comprehensive benefits
- The opportunity to work on challenging problems with a talented, diverse
- A dedicated budget for professional development, conferences, and
- Flexible working hours and a hybrid work
- A dynamic and innovative work environment where your technical vision will shape the future of our products.
www.orioninc.com
(18) Orion Innovation: Overview | LinkedIn
Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.
Candidate Privacy Policy
Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:
- What information we collect during our application and recruitment process and why we collect it;
- How we handle that information; and
- How to access and update that information.
Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.
Top Skills
Orion Innovation Melbourne, Victoria, AUS Office
Level 5, 447 Collins Street, Melbourne, Vic , Australia, 3000
