Job Description SummaryDepartment Overview: The Data solutions department is responsible for developing and maintaining commercial grade software products, that are in compliance and supportive of the overall architectural and product strategy. Utilizing best practices within the industry, as well as the currently defined technology stack, this department is responsible for delivering high quality, highly stable, and robust applications that perform to present and future expectations. Purpose: The Sr. Data Engineer position will be responsible for the design and development of data related solutions (databases, ETL systems, code, scripts, data models, reports, documentation) and supporting various products developed by Data Solutions department. The position requires extensive hands-on experience developing data related code (Spark, SQL, Python, and ETL) and associated code in a cloud/on-prem Linux/Windows environment. # Job Description Specific Duties, Activities, and Responsibilities: + Contributes to all aspects of big data solution development, including data analysis and design, Storage layout, data pipelines (stream and batch based), data transforms and integration, data quality checks, software deployments, configuration management, automated testing, maintenance, troubleshooting and analytic support. + Design, plan, and develop programs to perform automated extract, transform and load data between data sources when working with large data sets (TBs+ range) + Understand relational and non-relational database design principles, including normalization, de-normalization, and ability to read and interpret source and target systems. + Support data science teams with building data pipelines, tools and infrastructure and other platform needs. + Supports in evaluating new technologies, can break down complex problems and provide appropriate estimates for completing work. + Maintains architecture diagrams, data models, and source to target mappings, data dictionaries and detailed design documents. + Follows development processes including but not limited to conducting peer/code reviews, complying with organizational standards, ensuring code maintainability, following build processes, implementing unit tests, and following other industry standard best practices. + Supports Operations group to design and implement maintenance routines, automated monitoring solutions, and provides timely fixes for production systems by providing timely fixes. + Demonstrates continuous learning, thrives in a collaborative work culture and mentors other team members to be more effective. Position Requirements: + Bachelors in Computer Science or Information Systems. + 5+ years’ experience working with database platforms in large data environments (TB+). + 5+ years’ experience working with non-traditional data platforms in cloud or on-prem. (Snowflake, Synapse, Big Query, Redshift, EMR, Data bricks, Hadoop etc.) + 5+ years’ experience programming (Python, Spark, .Net, Scala etc.) Knowledge, Skills, and Abilities Requirements: + Production delivery experience in Big Data related technologies (Snowflake, Synapse, Big Query, Redshift, EMR, Data bricks etc.) + Strong Programming Experience - Python / Spark / SQL etc. + Experience building PAAS first big data platforms in Cloud. + Database design skills including normalization and data warehouse design + Performance tuning and optimization + Strong analytical / Debugging / Troubleshooting skills + Understanding of Distributed File Systems (HDFS, ADLS, S3). Toolset : + Spark / Python /SQL + Databricks / Snowflake / Synapse / MS SQL Server + ETL / Orchestration Tools (DBT etc.) + Azure /Cosmos / ADLS Gen 2 + git + Power BI/Tableau + ML / Notebooks + Hadoop 2.0 / Impala / Hive Other Requirements: + Ability to communicate clearly both verbally and in writing. + Ability to analyze complex application, business and operational issues and develop logical conclusions as well as identifying implications of proposed solutions. + Self-motivated, engaged and accountable for your own actions. + Understands who the customers are and strives to consistently meet their needs and SLAs. + Demonstrate flexibility to quickly learn and adopt new technologies. # Primary Work LocationUSA CA - San Diego TC Bldg C&D # Additional Locations # Work Shift Becton, Dickinson and Company is an Equal Opportunity/Affirmative Action Employer. We do not unlawfully discriminate on the basis of race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, or any other protected status.