AIQ-X AIQ-X Professional Suite

Advanced AI Evaluation & Diagnostics โ€ข Multi-Tier Testing โ€ข Fit-for-Purpose Analysis

๐Ÿš€ Getting Started with AIQ-X

๐Ÿ“š Step 1: Understanding Test Packs

Test packs contain questions that evaluate specific AI capabilities across different domains like logic, math, creativity, and ethics. Each pack has three tiers: Basic (quick), Advanced (thorough), and Expert (comprehensive). Start with importing a test pack from the /Test-Packs Library.

๐Ÿค– Step 2: Adding Models to Test

Click "New Model" in the Testing tab and give it a name (e.g., "GPT-4", "Claude Sonnet", "Gemini Pro"). You can test as many models as you want and compare their results side-by-side in the Compare tab. Models are saved locally in your browser.

๐Ÿงช Step 3: Running a Test

1) Go to Pack Library and select a test pack
2) Switch to Testing tab, choose your model and tier
3) Click "Copy Test Prompt"
4) Paste into your AI model's chat interface
5) Copy the AI's complete response
6) Paste back into AIQ-X response box
7) Click "Analyze" to see results

๐Ÿ“Š Step 4: Understanding Results

Scores measure response quality across multiple dimensions: depth, uncertainty calibration, structure, and domain-specific criteria. Higher scores indicate better capability in that area. Check the Compare tab for detailed analysis of strengths and weaknesses.

โœ… Pro Tips Import the "Fit For Purpose" pack from the Pack Library, then run a Basic tier test. This gives you a quick baseline for any model in about 5 minutes. View results in the Fit tab.
When the model completes its response simply select and copy the entire chat and paste into the app, only the actual response will be analyzed.
Share AIQ-X:
๐Ÿฆ Twitter | ๐Ÿ”— Reddit | ๐Ÿ”ถ HN