Data Engineer

₹ Not Disclosed | Experience 3 - 7 Years
Time Full Time | Location Chennai, India

Job Description :

  • Job Description: 
    We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To 
    succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of machine learning methods. 

    Job Requirements:  
    • Participate in the customer’s system design meetings and collect the functional/technical requirements.  
    • Build up data pipelines for consumption by the data science team.  
    • Skillful in ETL process and tools.  
    • Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture.  
    • Experience in writing Python programs and SQL queries.  
    • Experience in SQL Query tuning.  
    • Experienced in Shell Scripting (Unix/Linux).  
    • Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA.  
    • Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional.  
    • Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka  
    • Suggest and implement best practices in data integration.  
    • Guide the QA team in defining system integration tests as needed.  
    • Split the planned deliverables into tasks and assign them to the team.  
    • Needs to Maintain/Deploy the ETL code and follow the Agile methodology  
    • Needs to work on optimization wherever applicable.  
    • Good oral, written and presentation skills. 

Recommended Skills :

  • Preferred Qualifications:  
    • Degree in Computer Science, IT, or a similar field; a Master’s is a plus.  
    • Hands-on experience with Python and Pyspark Or  
    • Hands-on experience with Spark and SCALA.  
    • Great numerical and analytical skills.  
    • Working knowledge of cloud platforms such as MS Azure, AWS, etc..
    • Technical expertise in data models, data mining, and segmentation techniques

Key Skills :

       

Industry :

IT - Software

Education :

    • Associate Degree

Vacancies : 2

Posted On : 27 days ago

About Company :

Cynosure Corporate Solutions has one of the excellent teams that help build comprehensive workforce solutions for clients. Our team members are dedicated to providing a personalized experience to every client connecting with us. The team defines the values of hardworking and dedication with its performance in every project. We are a perfect blend of diversity and values, which helps us go further and has supported us to stay in the industry for 18+ years. With our core values of integrity and providing excellence in our services, we have been able to come to the top of the industry remarks.

Overview :

Headquaters
: Chennai
Type
: Sole Proprietorship
Revenue
: --
Industry
: Recruitment / Staffing
Founded
: 2004
Size
: --
Competitors
: --
Sector
: HR / Administration
Register for free
Suesys Learning