Returning Candidate?

Big Data Engineer

Big Data Engineer

Job Locations 
Product / Engineering

More information about this job


Shiftgig, one of Chicago’s hottest and fastest growing technology companies, is actively seeking a Data Architect in our Chicago office. We are a tech company in a non-tech space and as such, we have a lot of interesting problems to solve. We solve many of these using the large and diverse data set we have, as such you will be a key member of our team.


Currently, we have a team of three data scientists that are in need of technology support and direction in terms of pipelining data from both the Shiftgig product as well as supporting back-office platforms from sales, accounting, and recruiting. Today, this platform is a collection of SaaS-based tools that are performing various integrations, ETL processes, and data science algorithm hosting.


We currently lack a dedicated data engineering team member, and we are looking for a hands-on software engineer who is ready to dig in and evaluate the current state, and architect and deliver sustainable solutions to our data science team, and work with our product engineering team to create a cohesive real-time data analytics and insights platform.


Key upcoming projects are enabling our marketplace to have a data science driven algorithmic matching process between our workers and our customers that maximizes successful work outcomes in our marketplace. The direction of our matching and ratings will eventually drive experiments around dynamic pricing, upskilling opportunities, and recruiting efficiency.


  • 3-5 years developing high quality production software
  • Past experience in building high-quality software with an understanding of coding patterns, practices, and testing
  • Demonstrated experience in modeling and architecting scalable data systems
  • Experience working with various databases, such as:
    • PostgreSQL
    • SQL Server
    • MongoDB
    • Couchbase
    • Cassandra
    • Redis
  • Understand big data platforms, warehouses, relational, NoSQL and non-relational stores, and understand when best to use each of them
  • Organize macro level processes and systems
  • Have experience building non-trivial ETL solutions that scale, extracting data from operational product and business systems
  • Delivered business intelligence capabilities via tools like Domo/Tableau
  • Proven ability to take business needs and deliver data informed solutions
  • Experience with Agile development processes
  • Excellent written and verbal communication skills


Desired Qualifications:

  • 3+ years building aspects of a data pipeline and warehouse
  • Working with support teams to enhance testing practices for the future
  • Experience in using one or more of core AWS data technologies, such as:
    • Redshift
    • Hadoop
    • Kafka
    • Glue
    • RDS
  • Experience programming in one or more of our current core languages: Python, .NET, JavaScript, Java, Objective-C, Kotlin, and Swift
  • Expertise in agile software development process
  • Familiarity with common security concerns in web and mobile applications
  • Performance and load testing experience
  • Automated security tools knowledge
  • Working in a microservice-oriented architecture




About Shiftgig

Shiftgig was founded on the simple premise that many people want flexible work opportunities that fit into the rest of their lives, so we build technology that is focused on one thing: connecting people who want temporary work right now with businesses who need them.


We’re fulfilling our mission of connecting millions of people with millions of shifts via our mobile apps and platform. Our apps make it easy for businesses to post gigs and for qualified and skilled workers to claim them. Our platform handles shift fulfillment, and handles all the messy bits associated with labor management.


We are a tech company in a non-tech space with many interesting problems to solve. Our architecture is centered around internal and external APIs where the consuming clients are our single page applications and native mobile apps.