Bigeye Developer

Job Title : Bigeye developer (Remote)

Pay Rate: $28/hr / $35/hr

Duration : 12 W, 2 D

Job description for Bigeye developer

Summary

Through extensive data profiling, standardization, and on-going monitoring, the Data Quality developer serves a critical role in maximizing the utility of data within Snowflake. The developer must have a deep curiosity for exploring how data is used across the company, and a drive to improve the quality of the data to support operational efficiencies and complex decision making. This role requires broad technical acumen around data and its usage.

The Data Quality developer will establish the interface with Snowflake, profile and configure Bigeye for data pipelines as well as ongoing data quality metrics tracking.

Key Responsibilities

Configure Bigeye data observability solution to

• Develop interface with Snowflake

• Establish metadata from Snowflake within Bigeye along with generating extracts so that the metadata can be shared with Alation data catalog in agreed format

• Establish data lineage of data residing within Snowflake

• Automated monitoring of data pipelines going into Snowflake

• Automated monitoring of data within Snowflake

• Snowflake Data lineage through Bigeye

• Configuration of reports, metrics to showcase data anomalies within Snowflake

• Develop workflows, notifications about data anomalies

• In partnership with business and IT stakeholders, adhere to schedule of deliverables and milestones to ensure that data can be standardized in a timely manner.

• Lead meetings with stakeholders to demonstrate tool capabilities, configurations, and walkthrough of the solution.

• Profile data to ensure each source to target attribute is properly mapped based on its definition and use case. Additionally, understand the extent to which each attribute is standardized (e.g., naming conventions, value formats, domain of values, etc.), accurate, complete, and unique (e.g., duplicates, records not accurately categorized).

Typical Education

• Bachelor's Degree (B.A. or B.S.) from 4 year college or university

• Master's Degree (M.A. or M.S.) is preferred

Relevant Experience

• 3-5 years of relevant job experience in developing reports for data profiling and data quality

• At a minimum, experience of 1-2 projects using Bigeye or any other comparable data observability tool.

• Understanding of Snowflake and Financial data managed within Snowflake.

• Skilled at using SQL scripts to analyse and transform data.

• Usage of AI/ML to profile, identify rules, transform and cleanse data within data warehouse, data lakes

• Excellent interpersonal and communication skills

• Ability to act independently and as part of a team

• Track record of dealing well with ambiguity, prioritizing needs, planning and managing multiple projects, and delivering measurable results in a fast-paced environment

• Demonstrated partnering skills with both technical and non-technical partners.

• Self-motivated and results-oriented with a drive to learn new technologies.