CDP administrator will play a crucial role in configuring, maintaining, upgrading, & supporting the tools used in this domain of data warehouse and ensure availability of systems. This role requires pro-active skills and dynamic acumen in interacting with the data warehouse team including data engineers, data analysts, data architects, BI reporting team and analytics team. CDP administrator will also interact with infrastructure team in planning & maintaining the cloud data warehouse systems and work with auditors to ensure industry compliance.
Essential Functions
Manage & configure the IICS (Informatica Intelligent cloud service) tool to ensure pipelines comply with the SLAs.
Manage & configure the ingestion pipelines setup for various sources through Fivetran tool to ensure pipelines comply with the SLAs.
Manage & configure Google Big Query Administration
Manage projects, datasets & tables.
Answer audit questions and build/maintain automated process to help audit activities.
Secure resources and ensure correct access to the users.
Optimize workloads for best performance to control costs. Troubleshoot error messages and quotas to save costs.
Proficiency in relational database & SQL to manage and support day to day operations.
Manage Power BI administration for organization-wide settings in assigning roles and configuring, monitoring & provisioning organizational resources. Knowledge on Azure cloud technology will help in managing the Power BI efficiently.
Work involves promoting code for data pipelines, model work, reporting, and analytics code. Azure Devops and Github repositories are used for code promotions. CDP admin should have the knowledge to add/modify the Devops process as needed complying to auditing requirements.
Work with auditors in supporting user access reviews, defining roles and accesses to data warehouse tools and in general develop industry standard compliance process to adhere to PCI, SOX, GDPR, CCPA. Skills to automate audit activities is a must.
Development skills in writing python google function and using other google technologies, Unix shell scripting to automate and python coding skills to support ingestion and other application needs is preferred. Should have network knowledge to work with infrastructure network team to request firewall changes, network devices & a good understanding of WAN operations to deal with cloud-based data sources.
Should have good Unix knowledge to manage the IICS servers, FTP servers and manage Batch operations. Scripting with Unix shell & python to support batch operations is preferred. Should have good windows skills to ensure software tools availability and serve the data engineers, reporting, and analytics team. Establishing best practices in monitoring, maintaining, supporting data pipelines, data warehouse related servers, data warehouse software/tools & cloud data warehouse infrastructure.
Good knowledge on licensing of software used in Data Warehouse administration.
Knowledge on paid media digital marketing and relating APIs for data ingestion pipelines will be a plus. Document the activities & process relating to CDP administration and architecture.
Work with architects to maintain standards, manage architectural issues and recommend alternatives to simplify the methods and process.
Meet with subject matter experts in different areas of the business, be able to learn the concepts and business language relevant to their line of business and develop an understanding of how their data supports their business. processes. Performs other duties as assigned.
Complies with all policies and standards.
Skills & Competencies
Bachelor's degree in computer science, Engineering, or Information Systems.
Five (5) plus years SQL experience with Relation database systems (RDBMS).
Python code development using google function and Unix required and Unix shell scripting required.
Proficiency in Data Warehouse concepts (e.g., Star Schema, Data Model, Data Lake, Semantic Layer).
Excellent listening, verbal, and written communication skills; ability to communicate effectively at all levels of the organization and vendors.
Strong collaboration and interpersonal skills.
Demonstrated ability to perform duties and responsibilities on time with moderate supervision.
Good knowledge in administration of IICS (Informatica Intelligent Cloud Services), Fivetran, & GCP.
Ability to monitor and optimize BigQuery performance, including query optimization and resource allocation.
Strong knowledge of Google BigQuery, including its architecture, optimization, and best practices.
Understanding of cloud computing concepts and experience with cloud platforms, especially Google Cloud Platform.
Google Cloud certifications, especially those related to data engineering and cloud architecture, can be beneficial.