Gen AI Data Scientist

Company:  Diverse Lynx
Location: Austin
Closing Date: 19/10/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
Role Description:

Design and develop generative AI platforms and frameworks to accelerate use case development.

Develop pipelines to parse documents, chunk, vectorize, and persist vector stores.

Design vector store schemas.

Develop prompt templates with various prompt engineering techniques to interact with LLMs.

Experience in prompting with few-shot examples.

Develop semantic agents and interfaces between the agents.

Develop microservices and expose them as APIs.

Collaborate with architects and full-stack developers to deliver generative AI solutions.

Implement best practices for data management and model deployment.

Ensure the scalability and performance of generative AI solutions.

Essential Skills:

Proven experience in end to end development.

3 Tier Architecture based Application Development

Proven experience in search-related technologies (Elasticsearch, Kendra, Coveo) and any other vector store (Faiss, AWS OpenSearch/Azure AI Search).

Experience with back-end technologies (Python, Langchain, Django/Flask/FastAPI).

Experience with cloud platforms (AWS, Azure).

Knowledge of database technologies (SQL, NoSQL, Elastic/Solr).

Strong knowledge of AWS services such as S3, DynamoDB, DocumentDB, Lambda, Glue, SageMaker, Bedrock, and Kendra.

Experience in writing parsers to process unstructured data using AWS Textract.

Must have experience in prompt engineering and prompt template management.

Experience in developing agent frameworks.

Experience with natural language processing (NLP).

Desirable Skills:

Familiarity with DevOps practices and tools for CI/CD.

Experience with service architecture.

Experience in task-specific fine-tuning of LLMs.

Exposure to generative AI guardrails.

Knowledge of data governance and security best practices.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Apply Now
Share this job
An error has occurred. This application may no longer respond until reloaded. Reload 🗙