Big Data Engineer (ETL, Python, Bash or PySpark & Cloud exp. preferably GCP)

Job title: Big Data Engineer (ETL, Python, Bash or PySpark & Cloud exp. preferably GCP)

Job description: “The start date of this job is flexible and in order to find the best candidate the job may remain open much longer than the date mentioned on this posting…..or you may be asked to start sooner than the expected start date if you are able to do so!”

URGENT: Please read the job description below. If this interests you, please send a MS-Word version copy of your updated resume (ASAP) along with your salary expectations, first available date and a telephone contact number.

Please mention the job title above in the subject line
The recruiter in charge of this role is Manvir

If you do not think you are a match for this opportunity, but know someone who is, feel free to forward this email to them and you will be eligible for a referral bonus upon a successful hire.

One of our major Government clients is looking for a Big Data Engineer (ETL, Python, Bash or PySpark & Cloud exp. preferably GCP)
Location: Toronto, ON – Hybrid/Remote
Length: Permanent/ Full time

THE OPPORTUNITY
As a Data Engineer we are looking for someone who can create, expand, optimize data pipelines to enable continued research into audience behavior. You will solve problems with data integration, and will be keen to work with both structured and unstructured datasets. Our Data Engineer will join our growing Machine Intelligence practice and be responsible for research, development and deployment of data integration methodologies, uniquely catered to our various product offerings and content areas.

PERKS YOU CAN LOOK FORWARD TO:

• Hybrid work environment with flexible work schedules, allowing you to prioritize yourself, your family and your work;
• Work from home opportunities;
• Competitive total rewards package;
• 20% of time for innovation, learning and development; wherever your interests lie;
• Opportunities to work with cutting edge technology;
• Opportunities for continued learning and professional development;
• Opportunities to become a member of our Employee Resource Groups;
• A creative and dynamic work environment, where your ideas and contributions can be heard, valued and respected;
• A supportive management team committed to upholding the highest standards of diversity and inclusivity;
• An environment which favors experimentation and an iterative approach in order to achieve the highest form of technical innovation.

QUALIFICATIONS

• You have a minimum of two years of experience as a Data Engineer working with big data.
• Experience with data architecture and an understanding of database design principles. Implement business requirements through multiple phases of database design and development lifecycle. (i.e. database modeling, database architecture/ design, database development, testing, support/tuning, etc.)
• You will use modern tools to define, build and manage cloud infrastructure to gather, structure, and process millions of records from multiple sources to create clean and robust database models, at scale for data science applications.
• Experience documenting all the database changes including procedures, standards and process flow
• Experience with cloud platforms, preferably GCP and Big Query
• Experience with data streaming and distributed computing practices
• Strong NoSQL skills
• Lead and manage data lake ingestion and ETL tools
• A degree in Computer Science, Mathematics, Statistics or a related field is preferred. We value know-how over theoretical knowledge, we know not everyone gains their programming skills this way.
• Qualified candidates will be subject to a practical assessment of the above requirements. Assets:

o Strong Python skills
o Certification in Google Cloud platform
o Experience with Continuous Integration / Development pipelines (CI/CD)
o Experience with QA automation: You have experience enforcing and applying quality control for incoming and outgoing data.
o Familiarity with end-to-end data science application development

REQUIREMENTS:

• Minimum of 2 years of experience working as Data Engineer (or similar roles).
• Strong SQL knowledge.
• Proven experience building something in the cloud; preferably GCP.
• Must have ETL experience; extracting and transforming the data.
• Intermediate knowledge as a software developer.
• Familiar with the development/ deployment process.
• Familiar with Python, Bash or Pyspark.
• Proven experience building something in the cloud; preferably GCP.
• QA knowledge/ experience is a plus.

Please note that this is the most up to date version of job description available at this time – During Client Interview you will receive additional information – variance may apply !

Please note: Adherence to our end client’s vaccination policy is a requirement

Please visit the TEAMRECRUITER website to review other CAREER OPPORTUNITIES!

Company: Teamrecruiter.com

Expected salary:

Location: Toronto, ON

Job date: Thu, 17 Nov 2022 08:52:36 GMT

Job Source: Careerjet.ca

Click Here to Apply