BigData Sr, Developer/Lead

Company: Diverse Lynx
Location: Bethesda
Posted on: May 23, 2023

Job Description:

• 
  
• Involved in the Study of the business logic and coordinate with the client to gather the requirements.
  
• Experience with Hive, Nifi, Airflow, Snowflake and Kafka
  
• Experience in Cloud environments, particularly AWS - EC2, S3, Lambda
  
• Experience in Unit testing, integration testing for Spark scripts
  
• Scripting with Bash, CSH, Shell, or Python
  
• Designing and implementing large-scale ingest systems in a Big Data environment
  
• Optimizing all stages of the data life cycle, from initial planning, to ingest, through final display and beyond
  
• Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution capabilities
  
• Developing custom solutions/code to ingest and exploit new and existing data sources
  
• Working with Sponsor development teams to improve application performance
  
• Providing support to maintain, optimize, troubleshoot, and configure the AWS/spark/Hadoop environment as needed
  
• Collaborating with team-mates, other service providers, vendors, and users to develop new and more efficient method
  
• Experience with CI/CD pipelines, unit tests, integration, and regression testing
  
• Significant experience with Airflow
  
• Strong ability to manage competing priorities and communication to multiple stakeholders
  
  Bachelor's Degree in Computer Science, Computer Engineering, or a related discipline with experience in software design and development.
  
  
  
  
  
  
  
  Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  
  
  

Keywords: Diverse Lynx, Bethesda , BigData Sr, Developer/Lead, IT / Software / Systems , Bethesda, Maryland