Copy-ready job description
Edit the bracketed fields for your requirement.
Apache Spark Developer
About the role
We are looking for an Apache Spark Developer to join our team. You will build Spark applications for large-scale processing.
Responsibilities
- Build Spark applications for large-scale processing.
- Tune jobs and cluster settings.
- Work with data formats and storage layers.
- Test and schedule pipelines.
- Support production runs.
Required
- Apache Spark (PySpark or Scala)
- Distributed data processing
- SQL
- Performance tuning
- Data formats (Parquet, ORC)
Preferred
- Hadoop ecosystem
- Kafka
- Delta Lake
- Airflow
- Cloud platforms
Tools and stack
Apache Spark, PySpark or Scala, Parquet, Hive or Delta, Airflow, YARN or Kubernetes
Employment type: [Contract / W2 / C2C / Full-time]
Location: [City, ST / Remote]
Duration: [months]
Work authorization: [accepted types]Responsibilities explained
Each responsibility maps to something a candidate should be able to describe.
- Build Spark applications for large-scale processing.
- Tune jobs and cluster settings.
- Work with data formats and storage layers.
- Test and schedule pipelines.
- Support production runs.
Required skills
Treat these as the screen. If a candidate cannot speak to them, they are rarely a fit.
- Apache Spark (PySpark or Scala)
- Distributed data processing
- SQL
- Performance tuning
- Data formats (Parquet, ORC)
Preferred skills
Use these to rank candidates who meet the required list.
- Hadoop ecosystem
- Kafka
- Delta Lake
- Airflow
- Cloud platforms
Other titles this role appears under
Search and post under the variants your clients use.
- Apache Spark Developer
- Spark Developer
- PySpark Developer
- Big Data Developer
Seniority guide
Pick the level you need and state it plainly in the posting.
- Junior: writes transformations.
- Mid: owns jobs and tuning.
- Senior: designs processing architecture.
Tailoring a resume to this description
When you submit a consultant, mirror the required skills and tools in the summary and the most recent role, using only experience the candidate really has. MatchWire’s resume tailoring drafts this from the candidate’s stored work history and the posting.
Frequently asked questions
How long should a job description be?
Long enough to list the responsibilities, required and preferred skills, tools and logistics, usually 300 to 500 words.
Should I list a rate in the description?
If the client allows it, a range helps candidates self-select. Otherwise state it as “rate to be discussed” and confirm it before submitting.