Gramian Consultancy, a boutique firm specializing in IT professional services and engineering talent solutions, is seeking an experienced expert in Computer Science, Electrical Engineering, or Computer Engineering to lead a team of technical trainers. This role involves developing realistic, terminal-based tasks for advanced AI training and evaluation. The successful candidate will manage a pod of 5-10 trainers, ensuring tasks are technically accurate, reproducible, and reliably graded. These tasks will mirror authentic workflows in software, computational, and electrical engineering. This position combines deep technical expertise, problem-solving skills, quality assurance, and leadership to support the evaluation and enhancement of next-generation AI systems.
Key Responsibilities
- Lead and mentor a team of 5-10 technical trainers, maintaining consistent quality, productivity, and timely delivery of tasks.
- Review technical tasks thoroughly, including problem statements, codebases, circuit netlists, hardware description languages (HDL), datasets, computational environments, reference solutions, and automated tests.
- Validate tasks related to high-performance computing (HPC), parallel computing, algorithms, distributed systems, compilers, operating systems, databases, machine learning systems, GPU computing, circuit design, signal processing, power systems, and embedded systems.
- Ensure tasks reflect realistic software engineering, research, and electrical engineering workflows that require meaningful, multi-step technical reasoning.
- Verify technical correctness across multiple dimensions such as algorithm complexity, numerical accuracy, memory management, concurrency, circuit laws, power balance, signal processing, timing constraints, and system stability.
- Validate compilers, simulation tools, software dependencies, computational environments, and build processes to guarantee reproducible results.
- Identify unreliable tests caused by nondeterministic behavior, race conditions, hardware-dependent performance thresholds, or simulation convergence issues.
- Review automated graders to confirm they assess meaningful technical outputs, including functional correctness, performance, frequency response, waveforms, timing, efficiency, and system behavior.
- Detect technical inaccuracies, flawed assumptions, incorrect tolerances, and potential ways tasks could be bypassed without genuine computation or engineering analysis.
- Provide actionable technical feedback, track revisions, and ensure quality issues are resolved before task approval.
- Onboard trainers, allocate work, monitor quality and throughput, resolve technical blockers, and maintain technical documentation and best practices.
Required Qualifications
- PhD degree, postdoctoral experience, or equivalent advanced technical expertise in Computer Science, Electrical Engineering, Computer Engineering, or a closely related discipline is mandatory.
- Strong programming skills in languages such as C/C++, Rust, Python, Julia, Fortran, MATLAB/Octave, or hardware description languages (HDL).
- Advanced proficiency in Linux and command-line environments.
- Hands-on expertise in at least one major area, including parallel computing, systems programming, scientific software development, circuit simulation, signal processing, power systems, or digital hardware design.
- Solid understanding of algorithms, computational systems, numerical methods, software testing, or electrical engineering principles.
- Experience reviewing complex codebases, technical implementations, engineering simulations, or research outputs.
- Ability to evaluate algorithm correctness, computational performance, numerical accuracy, concurrency behavior, and technical reliability.
- Strong analytical judgment to identify technical errors, edge cases, race conditions, and flawed engineering assumptions.
- Experience mentoring, reviewing, or leading small technical teams.
- Excellent written communication skills for delivering precise technical feedback and maintaining documentation.
Contract Details
This is a contractor assignment for a duration of four weeks, with an hourly commitment of up to 40 hours per week. The position is fully remote and open to candidates located in Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Kenya, Nigeria, Turkey, and Vietnam. The selection process includes an AI-based interview.
No additional benefits or preferred qualifications were specified for this role.