Middle/Senior Data Engineer(Scala)

We create the software of the future. Join us!

01-01-2019 ООО "ВейвАксесс"

We are looking for an experienced data engineer to participate in knowledge-intensive international projects.



Tech Stack: Scala, Apache Spark, ClickHouse, HDFS, Apache Airflow, PostgreSQL, Apache Kafka, Apache Hive, Apache Iceberg





Required Skills and Experience:

  • Proficiency in Scala, Java or willingness to quickly master the basics of Scala
  • Basic Linux command line skills
  • Experience with Spark, solid understanding of working principles and potential issues
  • Knowledge of database fundamentals, strong SQL knowledge

Nice to Have:

  • Experience with Scala Dataframe/Dataset API
  • Experience in building and orchestrating ETL processes for Big Data processing
  • Experience in optimizing Spark queries and configuring resource consumption
  • In-depth understanding of Spark working principles and configuration parameters
  • Experience with Zeppelin or Jupyter
  • Experience with ClickHouse or other NoSQL databases
  • Experience with Apache Airflow
  • Knowledge of Hadoop/HDFS, working with Parquet files, working with Hive
  • Ability to work with GitLab CI
  • Sufficient knowledge of Bash for making corrections in scripts
  • Basic knowledge of Python
  • English language proficiency at B1 level or higher

Responsibilities:

  • Building and supporting ETL processes and solving various business tasks for processing large volumes of data using Spark and Scala
  • Optimizing data processing speed and system resource consumption
  • Identifying and resolving errors and anomalies in the resulting data
  • Creating medium complexity SQL queries for analyzing large volumes of data according to business requirements

We offer:

  • Various projects for international clients on modern technology stack
  • Friendly team and enjoyable working environment
  • Regular assessments and salary reviews
btn arrow Back to the list of vacancies

Apply for job Middle/Senior Data Engineer(Scala)

Thank you!

Your resume has been successfully submitted. We usually review resumes within a week. Please check your email for further information!

OK

Ouch!

There was a problem with your submission. Please try again later.

OK

Required field

Required field

Sorry, we didn’t catch your email

Minimum 6 characters

Required field

Attach
Summary

PDF or Word and no more than 20 MB in size.

How we process your personal data
When you submit the completed form, your personal data will be processed by WaveAccess USA. Due to our international presence, your data may be transferred and processed outside the country where you reside or are located. You have the right to withdraw your consent at any time.
Please read our Privacy Policy for more information.

Other vacancies

Analyst
  • Work experience as an analyst in an IT company for at least 1 year
  • Skills in working with charting tools
  • The ability to understand the architecture of the database, write simple queries
  • Experience with JIRA, Confluence
Project Manager
  • Strong understanding of software development processes
  • Ability to competently compose functional tasks for the team
  • Proactivity, and strong communication skills
  • Fluent English: Upper Intermediate and higher is considered an advantage
Python Developer
  • Confident knowledge and experience of commercial Python development
  • SQL/NoSQL — experience writing queries, PostgreSQL, MongoDB
  • Experience in writing integration and unit tests
  • Ability to conduct technical correspondence and work with project documentation in English (Intermediate level)

How we process your personal data

When you submit the completed form, your personal data will be processed by WaveAccess USA. Due to our international presence, your data may be transferred and processed outside the country where you reside or are located. You have the right to withdraw your consent at any time.
Please read our Privacy Policy for more information.