Great Question Logo

Great Question

AI Engineer

Job Posted 6 Hours Ago Posted 6 Hours Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
The AI Engineer will design and implement an agent-based UI for a customer research platform, focusing on LLM applications, prompt engineering, and optimizing AI responses for research tasks.
The summary above was generated by AI

AI Engineer

About the Company:

Great Question is the all-in-one customer research platform loved by teams from Intuit to Amazon, Canva and Figma. We're now looking to bring on an AI Engineer to help us enhance our platform with advanced AI capabilities, creating intelligent research assistants that will revolutionize how our customers conduct research.

We're a team of 30+, led by second time founders, who have 3x revenue through 2024, and we're looking to do it again in 2025. This is an opportunity to get in early, work on an exciting AI implementation, have a huge impact on the technology of an early-stage company, and shape the future of AI-assisted customer research.

This is a fully remote role open to people in the US or Canada with a strong preference to one of our hubs of Denver/Boulder Colorado, SF Bay Area California, Raleigh North Carolina; or Toronto Canada.

Why join us?

At Great Question, we're building a culture of collaboration, curiosity, and impact.

By joining our team, you will:

  • Work closely with a passionate, mission-driven team

  • Have a direct impact on the growth and success of the company

  • Be at the forefront of implementing practical AI solutions in a SaaS product

  • Shape the direction of our AI strategy and implementation

  • Learn from experienced startup founders (10 years experience, 2 previous exits)

  • Grow with the company - opportunity to specialize deeply in AI engineering or move into technical leadership

Why not join us?

At Great Question, we believe in transparency—not just about our strengths, but also about where we still have room to grow. Here's what you should know before deciding to apply:

  • Evolving AI Strategy: Our AI implementation is still in its early stages, so expect to help define approaches and best practices

  • Lean Teams, Big Impact: You'll wear multiple hats in the AI development process, from prompt engineering to implementation and evaluation

  • Fast-Paced Growth: We move quickly with high expectations, requiring creativity and comfort with iteration and occasional ambiguity

We're pretty far from perfect, and we don't claim to be. But we'd like to get there. So if you're someone who thrives on solving complex AI problems, enjoys creating intelligent systems from scratch, and loves being part of a dynamic, fast-growing environment, Great Question might be the right place for you.

About the Role:Role Overview

We are seeking a highly skilled AI Engineer to design and implement an agent-based UI on top of our existing customer research platform. You will be focused on creating an AI research assistant that can help our users create research studies, review documents, and act as an intelligent research companion. The ideal candidate will have expertise in prompt engineering, agent frameworks, and LLM application development with a focus on creating production-ready AI solutions in JavaScript.

Key Responsibilities

AI System Architecture & Development:

  • Design and build agent-based flows that integrates seamlessly with our existing platform

  • Develop sophisticated prompt templates that effectively interact with our API to create research studies, review documents, and assist in research activities

  • Evaluate and recommend the optimal framework for our use case (LangGraph vs. alternatives)

  • Implement the chosen agentic framework to create a coherent AI agent experience

  • Ensure the AI system can effectively understand user research needs and translate them into actionable research plans

Prompt Engineering & Optimization:

  • Create robust, reliable prompts that consistently produce high-quality outputs

  • Develop techniques to ensure AI responses remain factual, helpful, and aligned with research best practices

  • Optimize prompts for different use cases within the customer research workflow

  • Document prompt strategies and engineering decisions for knowledge sharing

Framework Selection & Implementation:

  • Provide expert guidance on the selection of appropriate agentic frameworks (whether LangGraph or alternatives)

  • Explain trade-offs between different frameworks in terms of performance, maintainability, and integration with our JavaScript stack

  • Stay current with the latest advancements in LLM agent frameworks and recommend improvements

  • Implement the chosen framework effectively within our JavaScript environment

Evaluation & Quality Assurance:

  • Design and implement comprehensive evaluation frameworks to measure AI system performance

  • Create automated tests to ensure consistent AI behavior across different scenarios

  • Develop monitoring systems to track AI system performance and identify areas for improvement

  • Collaborate with the product team to gather user feedback and iterate on AI capabilities

Technical Integration:

  • Work with our strong frontend resources and app developers to integrate AI capabilities

  • Focus primarily on the prompting strategy and agentic framework rather than frontend implementation

  • Ensure AI features are developed in JavaScript to align with our tech stack

  • Document technical specifications and implementation details for the broader team

Qualifications

  • Bachelor's degree in Computer Science, AI, or related field

  • 5+ years of experience in software development, with at least 1-2 years focused on LLM applications

  • Strong programming skills with experience implementing LLM applications (JS preferred)

  • Demonstrated expertise in prompt engineering and LLM application development

  • In-depth knowledge of various agent frameworks (LangGraph, LangChain, AutoGPT, BabyAGI, etc.) and ability to evaluate their strengths and weaknesses

  • Experience designing, implementing, and evaluating AI systems in production environments

  • Excellent problem-solving skills and attention to detail

  • Strong communication skills and ability to explain complex AI concepts to non-technical stakeholders

  • Experience with evaluation frameworks and testing methodologies for LLM applications

Nice to Have

  • Knowledge of customer research methodologies and practices

  • Previous work with research or data analysis tools

  • Experience building AI assistants or agents for specific domains

  • Understanding of UX principles for AI interfaces

Support Structure

You'll be working closely with our engineering team who will provide support in:

  • Strong frontend resources who will handle UI implementation

  • App developers who will assist with platform integration

  • DevOps infrastructure and deployment

  • Web/API programming integration

  • Business domain knowledge and customer research expertise

Your primary focus will be on the AI-specific components: prompt engineering, agentic framework selection and implementation, and ensuring the AI performs effectively for research tasks.

Benefits

  • Competitive salary

  • Flexible remote work arrangement

  • Opportunity to work on cutting-edge AI applications

  • Potential for long-term relationship based on project success

  • Work with a growing startup making real impact in the customer research space

Hiring Process

We endeavor to deliver a great candidate experience, including notifications of your status in the hiring process throughout.

The hiring process includes the following steps and typically happens across 2-3 weeks from first interview:

  1. Initial phone screens for shortlisted candidates

  2. Technical Interview with CTO, delving into your AI experience

  3. Systems Design Interview

  4. Coding Interview

  5. Interview with Co-Founder & CEO

  6. Reference checks

Note - Each interview is sequential, so you'll only move to the next round if you pass the previous one. After each interview, we'll aim to notify you if you're progressing within 3 days of your interview taking place.

How to Apply

If this sounds like the opportunity you've been waiting for, we'd love to hear from you! Please submit your resume, making sure it's a concise representation of your previous work experience.

Where applicable in your resume, please include specific examples of AI systems you've built in JavaScript, with concrete metrics on their performance and impact. We're particularly interested in your experience evaluating and implementing different agentic frameworks.

Note, we will only ever contact you over email using a greatquestion.co email address.

Top Skills

Autogpt
Babyagi
JavaScript
Langchain
Langgraph
Llm Applications

Similar Jobs

5 Days Ago
Remote
United States
168K-330K Annually
Senior level
168K-330K Annually
Senior level
Big Data • Cloud • Software • Database
As a Forward Deployed AI Engineer, you will collaborate with enterprise clients to modernize applications and implement AI tools. The role involves hands-on technical work and requires expertise in software engineering, AI concepts, and problem-solving skills.
4 Days Ago
Remote
United States
118K-231K Annually
Senior level
118K-231K Annually
Senior level
Big Data • Cloud • Software • Database
Lead AI projects by developing and shipping AI-powered features to enhance customer workloads. Collaborate with teams to improve AI products and establish development best practices.
Top Skills: AWSGenerative AiGCPAzureMongoDB
10 Days Ago
Remote
United States
150K-230K Annually
Senior level
150K-230K Annually
Senior level
Artificial Intelligence • Legal Tech • Professional Services • Software
Design and develop AI-powered solutions focusing on LLM technologies, collaborating with teams and interacting with customers to align products with needs.
Top Skills: GoPythonReactTypescript

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account