AI work directory Red Pen Jobs

Big Data Engineer

micro1 Contract 50 openings Posted 1 month ago US, UK, EU, CA, AU, NZ

Role details

Skills the posting asks for

  • big data
  • Python
  • databases
  • data engineering

Job Title: Big Data Engineer

Job Type: Contractor

Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.

Key Responsibilities:

  • Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.
  • Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.
  • Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.
  • Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
  • Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.
  • Enforce data quality, security, and governance standards across all solutions.
  • Document solutions and communicate complex technical concepts effectively, both in writing and verbally.

Required Skills and Qualifications:

  • Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.
  • Advanced proficiency in Python for data processing, automation, and integration.
  • Deep understanding of relational and NoSQL databases, including optimization and management techniques.
  • Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).
  • Strong foundation in data modeling, ETL processes, and data warehousing principles.
  • Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non-technical stakeholders.
  • Detail-oriented, proactive, and self-motivated, thriving in remote and autonomous work environments.

Preferred Qualifications:

  • Prior experience in fast-paced or startup-like environments supporting global teams.
  • Expertise with cloud-based big data platforms (e.g., AWS, GCP, Azure).
  • Familiarity with machine learning operations and data science workflows is a plus.

From the micro1 posting.

Applying on micro1

What happens after you click

  1. The link opens this role on micro1. Sign up and apply from there.
  2. An AI interview, 20 to 40 minutes.
  3. If micro1 hires you, they match you to a project.
  4. Remote — open to United States, Canada, United Kingdom, Ireland, Australia, New Zealand, Germany, France, Netherlands, Belgium, Austria, Switzerland, Denmark, Sweden, Norway, Finland, Iceland, Italy, Spain, Portugal, Greece, Luxembourg, Malta, Cyprus, Liechtenstein and Monaco.
Apply on micro1 Prepare for the interview

If you're hired and complete 10 hours, micro1 pays this site a referral fee. Your pay is unaffected.

Red Pen Jobs is independent. We are not affiliated with, endorsed by, or acting for micro1 in any way, and we do not recruit on its behalf.

More about micro1: how it pays, what it does not say, and its referral terms.

Questions about applying? Read the FAQ.

New roles for software engineers every Monday

What the email looks like

  • Open Source GitHub Maintainer

    $150–300 an hour · micro1

  • Cybersecurity Research Expert – Offensive Security & Vulnerability Research

    $200–250 an hour · Mercor

  • Senior Software Engineering Experts

    $120–180 an hour · Mercor

Software engineers

The same work on another platform

Already have a micro1 account? A platform you have not signed up to yet is where this kind of work is still open to you. Each one screens and pays on its own terms, so check theirs before applying.

More roles for software engineers

Every role we hold for software engineers

Pays $30–80 an hour, close to the $80 median top rate of the 116 other open hourly software engineers roles listed here. 50 openings, among the largest in this profession here. Posted 6 weeks ago.

We read this listing on micro1 on 15 Sep 2026 and checked it again on 30 Oct 2026. We clean its formatting for readability and safety. View on micro1

Do you have a micro1 account?

Either way, you can apply.

No, I'm new. Apply

If you're hired and complete 10 hours, micro1 pays this site a referral fee. Your pay is unaffected.