Note: The job is a remote job and is open to candidates in USA. 24-MAG LLC is offering a specialized part-time consulting opportunity for experienced electrical engineering professionals. The role involves reviewing complex STEM prompts, verifying expert-level answers, assessing evaluation rubrics, and providing detailed feedback to ensure high-quality project execution.
Responsibilities
- Review complex STEM and electrical engineering problem prompts for clarity, technical rigor, completeness, and suitability as training data
- Independently verify ground truth answers for graduate-level electrical engineering problems
- Evaluate whether task prompts require appropriate domain reasoning, clear assumptions, and technically sound solution paths
- Identify ambiguous wording, missing constraints, incorrect assumptions, incomplete derivations, or weak problem construction
- Assess golden answers for correctness, completeness, mathematical rigor, and alignment with the stated task requirements
- Review grading criteria for robustness, objectivity, and consistency across acceptable solution approaches
- Determine whether evaluation rubrics properly capture correct reasoning, valid alternatives, numerical tolerances, and common error cases
- Provide Accept, Revise, or Reject verdicts with concrete written explanations
- Assess simulated research environments for scientific realism, construction quality, and diversity
- Review seed prompts and multi-agent trajectories to evaluate whether research-style workflows are plausible and technically meaningful
- Read and summarize model agent rollouts, including stronger and weaker solution attempts
- Identify issues related to unrealistic reasoning, weak scientific setup, poor trajectory diversity, or insufficient domain grounding
- Provide clear written feedback explaining electrical engineering reasoning, grading concerns, task-quality issues, and suggested improvements
- Follow standardized review forms, detailed task instructions, and project-specific quality criteria accurately
- Review discrete STEM QA deliverables within expected timelines
- Collaborate through asynchronous project workflows to improve technical training data quality and AI-assisted STEM evaluation outputs
Skills
- MS or PhD in electrical engineering or a closely related technical field
- Strong ability to independently verify ground truth solutions for graduate-level electrical engineering problems
- Experience reviewing technical problems, grading methodologies, solution explanations, model outputs, or structured STEM tasks
- Strong scientific reasoning and ability to evaluate technical correctness, methodological soundness, and problem clarity
- Ability to summarize complex model-generated reasoning trajectories clearly and objectively
- Strong attention to detail and ability to identify subtle errors in reasoning, assumptions, calculations, or grading logic
- Comfort reviewing AI-generated STEM content and applying detailed evaluation criteria
- Excellent written communication skills
- Ability to work independently in a remote, asynchronous, project-based environment
- Advanced expertise in one or more electrical engineering subdomains, such as circuits, signal processing, control systems, power systems, electromagnetics, communications, semiconductor devices, embedded systems, or related areas
- Experience teaching, grading, reviewing, or designing graduate-level electrical engineering problems
- Familiarity with rubric-based review, benchmark evaluation, technical QA, research-style assessment, or structured feedback workflows
- Experience evaluating multi-step mathematical solutions, simulation-based reasoning, symbolic derivations, or numerical verification
- Ability to provide concise, actionable feedback for both technical correctness and training data quality
Benefits
- Remote structure with competitive compensation
- Weekly payments via Stripe or Wise
Company Overview