diff --git a/deliverables/proposals/index.md b/deliverables/proposals/index.md index b5adfcb..9fffcf3 100644 --- a/deliverables/proposals/index.md +++ b/deliverables/proposals/index.md @@ -66,7 +66,12 @@ Date: 2026-04-29 Status: AWAITING DAVID'S APPROVAL Summary: Proposal for the Foreman Probe project to model probe tasks created by the Foreman to benchmark and evaluate LLM capabilities. This fills the gap in internal evaluation by providing a focused framework for testing LLM performance in Foreman-specific scenarios. It differs from prior proposals by emphasizing the direct application of these tasks in operational contexts, integrating both technical metrics and practical workflows for more robust validation. -### Crimson Leaf Holdings -- Task 8a9ad04b-b49f-4053-a063-c6fdb562927a +### Crimson Leaf Holdings -- Task bf9a4a39-de0e-402b-af3d-c4da508c810c Date: 2026-04-29 Status: AWAITING DAVID'S APPROVAL -Summary: Proposal for the Foreman Probe project to model probe tasks created by the Foreman to benchmark and evaluate LLM capabilities. This fills the gap in foundational probing infrastructure by establishing core models that mirror the Foreman's task-creation logic, enabling baseline assessments of LLM agentic behavior. It differs from prior proposals by prioritizing the fundamental modeling of task structures over advanced integrations, adversarial elements, or comprehensive ecosystems, providing a essential building block for subsequent specialized probes. \ No newline at end of file +Summary: Proposal for the Foreman Probe project leveraging construction industry search results on Foreman planning, estimating software, and proposal workflows to create authentic probe tasks that simulate real-world contractor operations. This fills the gap in domain-specific benchmarking by grounding LLM evaluation in practical construction management practices like look-ahead planning and bid proposals. It differs from prior proposals by directly incorporating external industry resources and tools such as Contractor Foreman demos to model realistic Foreman task generation in construction contexts. + +### Crimson Leaf Holdings -- Task 847c9d22-a1f8-4b2e-b673-41e5c2b8d9f3 +Date: 2026-04-29 +Status: AWAITING DAVID'S APPROVAL +Summary: Proposal for the Foreman Probe project to create iterative probe tasks that model the evolving workflow patterns of Foreman systems across multiple project phases. This fills the gap in lifecycle-based benchmarking by capturing how LLM performance changes as projects progress through planning, execution, and completion stages. It differs from prior proposals by focusing on temporal dynamics and phase-dependent task complexity rather than static scenarios, enabling validation of sustained reasoning across extended operational sequences. \ No newline at end of file