Data Engineer Job at Division of Information Technology - NYC Department of Health and Mental Hygiene
Division of Information Technology - NYC Department of Health and Mental Hygiene Long Island City, NY 11101
The New York City Department of Health and Mental Hygiene (DOHMH) is the nation's leading public health agency protecting and promoting health of all New Yorkers. Our 7,000-plus team members bring an extraordinary array of languages, cultures, and experiences to bear on the work of public health. Our diversity fuels creativity because all perspectives are heard and valued. DOHMH aims to improve the health outcomes of all New Yorkers by centering persistent racial inequities and promotion of social justice at the core of its work.
The Division of Information Technology aims to align technology solutions with the DOHMH mission by prioritizing resource use and deploying innovations that facilitate the agency’s day-to-day activities and enhance staff productivity and efficiency. Our goal is to provide users with a reliable, stable, and safe computing environment, through the collaboration of the Bureau of Technology Strategy & Project Management provides business analysis and IT project management services to define and deliver IT solutions that meet all program needs.
**This a grant-funded W-2 position with full employment benefits that expires 6/30/2025 (possibility for extension) hired through Public Health Solutions and will be assigned to NYC DOHMH. Only those with authorization to work in the U.S. without sponsorship should apply. This is an on-site position, no remote or hybrid option available. Professional references are required. **
The agency is seeking a Data Engineer (Azure, SQL, Python) to help in the infrastructure, process, and procedures to create “data lakes” in the cloud for large amounts of public health data including but not limited to syndromic surveillance, electronic laboratory and case reporting, notifiable diseases, vital records, mental health, maternal mortality, chronic diseases, as well as agency operational data such as finance, human resources, emergency operations, and information technology data. This data will be made available to analysts across DOHMH to consume and process in analytic platforms such as R, Python, SAS and visualize them in tools like Tableau, Power BI, Data Wrapper. In addition, the data can be processed with machine learning algorithms to help make more informed policy and operational decisions.
Job Duties:
- Engineer data pipelines using a variety of technologies including Azure Synapse, SQL, SSIS, Python to extract, transform and load data.
- Load and transform data from external sources and partners in a variety of different structured and unstructured file formats as well as internal on-premises data and applications primarily in SQL databases and CSV file formats.
- Process public health data requests following applicable procedures and document changes in an electronic repository.
- Apply technical knowledge to architect solutions that meet business needs, create Data Platform, AA/AI roadmaps, and ensure long term technical viability of new deployments, infusing key analytics and AI technologies where appropriate (e.g., Azure ML, ML Server, BOT framework, Cognitive Services, Big Data, Data Lake, Azure Databricks, etc.).
- Ensure that solution exhibits high levels of performance, security, scalability, maintainability, appropriate reusability, and reliability upon deployment
- Develop deep relationships with key customer IT decision makers, who drive long-term cloud adoption within their company to enable them to be cloud advocates.
- Assess the Customers' knowledge of Azure platform and overall cloud readiness to support customers through a structured learning plan and ensure its delivery through partners.
- For senior data engineers, supervisor or mentor junior data engineer and analysts.
Qualifications and Requirements:
- 5+years of experience with Azure data platform including Azure SQL, Azure Data Factory, Azure Databricks, Azure SQL Data Warehouse (Synapse Analytics), Azure Data Lake Storage, Azure Cosmos DB, SQL Server, SSIS, SSRS, etc.
- Strong Object relational mapping experience with UML modeling and OO modeling.
- Experience with T-SQL, SSIS, Power BI and Azure Analysis Services
- Experience with developing data pipelines using python.
- Strong problem solving and analytical skills.
- Passion for public health and solving problems and creating new insights through data.
- Experience working with Healthcare data and proven track of implementation experience in EDI data formats.
- Experience in job roles involving metadata management, relational dimensional modeling and big data solution approaches with native Azure Data Platform tools or 1st party services.
- Excellent communication, presentation skills with the right attitude towards problem solving in diverse teams.
- Strong aptitude and technical skills with conceptual strength in logical solutions driven towards balanced optimal considerations.
- Solid knowledge in SQL, security standards, BI tools, ETL tools and Microsoft Azure specific technologies.
- Certifications in Azure, data modeling and metadata management.
- Ability to use BI tools like Power BI to represent insights and other presentation techniques.
Job Type: Full-time
Pay: $100,000.00 - $130,000.00 per year
Benefits:
- Health insurance
Schedule:
- 8 hour shift
Work Location: One location
Please Note :
www.epokagency.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, www.epokagency.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.