Job Description...
The main function of a data engineer is to design, build, and manage the information or big data infrastructure that supports data analysis and processing in the way an organization needs it. A typical data engineer is responsible for developing the architecture and ensuring smooth system operation for handling large sets of data.
Job Responsibilities:
Build, optimize, and maintain conceptual and logical database models.
Develop data set processes for data modeling, mining, and production.
Utilize programming languages and tools to integrate systems and manage data.
Implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Collaborate with data scientists, business stakeholders, and IT team members on project goals.
Ensure data governance and compliance with data security and privacy policies.
Skills:
Proficiency in programming languages such as Python, Java, Scala, or Ruby.
Expertise in big data technologies such as Hadoop, Spark, and Kafka.
Experience with data integration, processing, and relational SQL and NoSQL databases like PostgreSQL or MongoDB.
Knowledge of data pipeline and workflow management tools.
Familiarity with data visualization tools like Tableau or Power BI.
Understanding of machine learning algorithms and data science fundamentals.
EEO Employer
LanceSoft is a certified Minority Business Enterprise (MBE) and an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws.
This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. LanceSoft makes hiring decisions based solely on qualifications, merit, and business needs at the time.