Software Engineer - Python UNIX

Company: CG Consulting Group
Location: Plano
Posted on: May 25, 2023

Job Description:

Back End Software Engineer (Python and UNIX)

This is with a global IT services firm for a leading telecom firm.
Candidate should have legal work status - ideal if citizen, Green Card Holder, etc.
Location is Plano/Dallas, Texas, USA
Hybrid - 2 days in office per week
6 months contract, possible extension.
Market rate

Description
This role is ideal for an experienced engineer who has a keen interest in working with large data sets to design and develop client facing platforms (measurement, attribution, reports, visualization, data feeds, yield, audience creation) for the complex Media & Advertising industry.
Need for 'gurus' in Python and UNIX, in addition to the other listed required skills. Understanding in depth Python like memory management (RAM level), Python to AWS locking, running Python with AWS Lambda, virtual environments, containers. UNIX exposure to deep commands and scripting like arch, filters and socket manipulation.

Responsibilities
Responsible for driving the design and implementation of specific data models to drive better business decisions through insights from a combination of 3rd party and 1st party data assets. Accountable for developing the necessary enablers and data platform in a cloud Environment and has the responsibility of maintaining its integrity during the life cycle phases. Define data requirements, gather and mine large scale of structured and unstructured data, and validate data by running various data tools.
Support the standardization, customization, and ad-hoc data analysis, and will develop the mechanisms to ingest, analyze, validate, normalize, and clean data. Develop and maintain data engineering best practices and contribute to Insights on data analytics and visualization concepts, methods, and techniques.

--- Design and develop data applications using selected tools and frameworks as required and requested.
--- Collaborate with Engineers and Business to build intuitive products that address the needs of our customers.
--- Read, extract, transform, stage and load data to selected tools and frameworks as required and requested.
--- Gather and process raw data at scale.
--- Perform tasks such as writing scripts, web scraping, calling-writing APIs, write SQL queries, etc.
--- Work closely with the engineering team to integrate your work into our production systems.
--- Process unstructured data into a form suitable for analysis. Analyze processed data.
--- Participate in design and code reviews to ensure the quality of the products we deliver.
--- Mentor more junior engineers on designing robust applications and implementing maintainable code.
--- Establish a good working rapport with Development group, System Engineers, Quality Assurance/Testers, and Business users
--- Develop scripts or workflows to facilitate complex ingress processes
--- Design Participate in Daily Scrum calls as well as quarterly sprint planning sessions to support development efforts
--- Willing to coordinate an offshore team (different time zone).

Skills
Must have
--- 10 + years of recent experience in data engineering and/or software development, ETL work
--- A solid track record of data management showing your flawless execution and attention to detail.
--- Programming experience, ideally in Python, Java Script and a willingness to learn new programming languages to meet goals and objectives.
--- Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
--- Good Understanding of Databases and Datawarehouse tools
--- Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
--- A willingness to explore new alternatives or options to solve data mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done.

Must be an expert:
--- Python deep knowledge (Lead Expert): Boto3, Multiprocessing, Classes
--- UNIX deep knowledge in development and scripting
--- API development using AWS
--- Snowflake expertise
--- Java Script (Snowflake SP)
--- AWS: Lambda, Triggers, EC2, S3, CloudWatch, Security.
--- Snowflake: SQL & Stored Procedures
--- Airflow: Celery, MQRabbit, Postgress
--- Unix-Linux: Shell Scripting, admin experience
--- Experience building APIs

Nice to have
--- Looker
--- Informatica
--- Teradata Job Title
Software Engineer - Python UNIX

Keywords: CG Consulting Group, Plano , Software Engineer - Python UNIX, IT / Software / Systems , Plano, Texas