摘要
About the Role
Key Responsibilities:
- Design, develop, and optimize data pipelines using PySpark to process and analyze large datasets.
- Write complex SQL queries for data extraction, transformation, and loading (ETL).
- Work with Databricks to build and maintain collaborative and scalable data solutions.
- Implement and manage CI/CD processes for data pipeline deployments to ensure seamless and efficient integration and deployment.
- Collaborate with data scientists and business analysts to understand data requirements and deliver appropriate solutions.
- Ensure data quality, integrity, and security across all data processes.
- Monitor and troubleshoot data pipelines and workflows to resolve issues promptly.
- Continuously improve data and code quality through automation and best practices.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
- Proven experience with PySpark, including developing and tuning data processing applications.
- Advanced proficiency in SQL and experience in writing complex queries and optimizing them for performance.
- Hands-on experience with Databricks, including notebooks, clusters, and integration with other data tools.
- Strong understanding of CI/CD pipelines and experience with tools such as Jenkins, GitLab CI/CD, or Azure DevOps.
- Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and related data services.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Skills:
- Knowledge of data warehousing concepts and tools (e.g., Snowflake, Redshift).
- Good to have knowledge on kedro framework.
Why Novartis: Helping people with disease and their families takes more than innovative science. It takes a community of smart, passionate people like you. Collaborating, supporting and inspiring each other. Combining to achieve breakthroughs that change patients’ lives. Ready to create a brighter future together? https://www.novartis.com/about/strategy/people-and-culture
Join our Novartis Network: Not the right Novartis role for you? Sign up to our talent community to stay connected and learn about suitable career opportunities as soon as they come up: https://talentnetwork.novartis.com/network
Benefits and Rewards: Read our handbook to learn about all the ways we’ll help you thrive personally and professionally: https://www.novartis.com/careers/benefits-rewards
Accessibility and accommodation
Novartis is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the recruitment process, or in order to perform the essential functions of a position, please send an e-mail to [email protected] and let us know the nature of your request and your contact information. Please include the job requisition number in your message.
Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.
