CaseStudies

MassGen v0.0.12-0.0.14: Enhanced Logging and Workspace Management

MassGen v0.0.12-v0.0.14 introduces comprehensive logging functionality and improved workspace management for multi-agent workflows, enabling better debugging, analysis, and artifact tracking. This case study demonstrates these improvements through a creative web development task.

:depth: 3
:local:

📋 PLANNING PHASE

📝 Evaluation Design

Prompt

“Create a website about a diverse set of fun facts about LLMs, placing the output in one index.html file”

Baseline Config

Prior to v0.0.12, for multiple Claude Code agents to collaborate, they need to use the same workspace, which often cause conflicts. If they use separate workspaces, they don’t collaborate smoothly.

Baseline Command

massgen --config @examples/tools/filesystem/claude_code_context_sharing "Create a website about a diverse set of fun facts about LLMs, placing the output in one index.html file"

Expected Result

Agents don’t know where to find the workspace associated with an agent. Even if that info is included in the answer of an agent, the agents might overwrite each other’s work or create conflicting files in the same directory, leading to confusion and lost work.

🔧 Evaluation Analysis

Current Failure Modes

Before v0.0.14, MassGen had basic logging but lacked critical features:

  1. No Version History: Lost intermediate agent iterations - only final outputs were preserved in agent_outputs
  2. No Final Workspace Copy: Winning solution wasn’t duplicated to a clear final_workspace directory for easy access
  3. No Agent-Specific Versioning: Outputs weren’t organized in per-agent timestamped folders for tracking evolution

Success Criteria

The new logging and workspace features would be considered successful if:

  1. Comprehensive Logging: All agent activities logged with timestamps
  2. Final Deliverables: Explicit capture of final workspace snapshots and selected agent
  3. Timestamped Organization: Clear chronological structure of all outputs
  4. Workspace Isolation: Each agent maintains separate working directories
  5. Debug Capabilities: Easy analysis of multi-agent coordination and decision-making

🎯 Desired Features

  1. Per-agent versioned logging: Every generated answer is saved in timestamped folders per agent (e.g., claude_code_agent1/20250901_202649_594259/).
  2. Final workspace snapshot: A final_workspace/ copy of the winning solution for quick access and reproducibility.

🚀 TESTING PHASE

📦 Implementation Details

Version

MassGen v0.0.14 (September 1, 2025)

✨ New Features

The enhanced logging and workspace management system in v0.0.14 provides:

1. Per-Agent Versioned Logging

2. Final Workspace Snapshot

3. Comprehensive Debug Capabilities

New Configuration

Configuration file: massgen/configs/tools/filesystem/claude_code_context_sharing.yaml

Key workspace configuration:

agents:
  - name: claude_code_agent1
    workspace: claude_code_workspace1

  - name: claude_code_agent2
    workspace: claude_code_workspace2

Command

massgen --config @examples/tools/filesystem/claude_code_context_sharing "Create a website about a diverse set of fun facts about LLMs, placing the output in one index.html file"

🤖 Agents

Both agents use Claude Code’s file management capabilities with:

🎥 Demo

MassGen v0.0.14 Logging and Workspace Demo

📊 EVALUATION & ANALYSIS

Results

The v0.0.14 logging and workspace improvements successfully achieved all success criteria and demonstrated new collaboration capabilities.

📊 Enhanced Logging - The Core Improvement

The most significant change is the comprehensive logging system that captures every aspect of multi-agent workflows:

Evidence from actual log directory structure:

massgen_logs/
└── log_20250901_202552/
    ├── agent_outputs/
    │   ├── system_status.txt                       # Complete timeline with timestamps
    │   ├── claude_code_agent1.txt                  # Agent 1's complete output
    │   ├── claude_code_agent2.txt                  # Agent 2's complete output
    │   └── final_presentation_claude_code_agent2.txt  # Winning solution (40K+ tokens)
    ├── claude_code_agent1/                         # Agent 1's versioned outputs
    │   └── 20250901_202649_594259/                 # Timestamped iteration with microseconds
    │       └── index.html                          # Generated website version
    ├── claude_code_agent2/                         # Agent 2's versioned outputs
    │   └── 20250901_202706_647603/                 # Timestamped iteration with microseconds
    │       └── index.html                          # Generated website version
    ├── final_workspace/                            # Final deliverable
    │   └── claude_code_agent2/
    │       └── 20250901_203333_084001/             # Final winning version timestamp
    │           └── index.html                      # Selected implementation
    └── massgen.log                                 # Main execution log

🎯 Enhanced Collaboration

Before: “Error: File already exists” or silently overwrites existing work

After: Each agent successfully creates its own version without conflicts

The agents now:

  1. Work independently in separate workspace directories
  2. Preserve all outputs for later comparison and voting

🗳️ Voting Process Enhancement

With isolated workspaces, the voting process becomes more meaningful:

💡 Implementation Differences

The two agents took distinctly different approaches:

Agent 1’s Website Implementation:

Agent 1 Implementation

Agent 2’s Website Implementation:

Agent 2 Implementation

🏆 Final Implementation - Combined Solution

Winning Agent: Agent 2 (claude_code_agent2) with elements from Agent 1

The final implementation combined the best features from both agents:

The final solution demonstrated MassGen’s ability to:

  1. Synthesize multiple approaches into a superior final product
  2. Preserve all iterations in timestamped folders for reference
  3. Select and enhance the best implementation through the voting process

The complete final implementation was preserved in:

Final Implementation

🎯 Conclusion

The logging and workspace improvements in v0.0.14 represent crucial advancements for multi-agent collaboration:

  1. Add_log Feature: Preserves every generated answer version from each agent
  2. Final Deliverables: Clear identification of selected outputs and agents
  3. Timestamped Organization: Chronological tracking of all agent activities
  4. Workspace Isolation: Conflict-free parallel agent execution
  5. Version History: Complete iteration tracking for debugging and analysis

Broader Implications: This establishes MassGen as a platform capable of:

The success of this case study validates the workspace isolation approach and demonstrates clear value for users requiring multiple agents to work on file-based tasks simultaneously.

📌 Status Tracker