Cross-Evaluation Synthesis: Solomon Islands

What five DFAT evaluations reveal together that none reveals alone — Experiment, 23 September 2026

The experiment

Individual DFAT evaluations assess one program. But development programs in Solomon Islands don't operate in isolation — they share the same government counterparts, face the same capacity constraints, and are delivered by overlapping managing contractors. Cross-cutting patterns are invisible unless you read across evaluations.

This synthesis reads five evaluations spanning private sector development, infrastructure, governance, justice, water supply, and fiscal budget support — approximately AUD 800M+ of Australian investment in Solomon Islands.

Source evaluations

Seven cross-cutting findings

1. Government capacity is the binding constraint — every evaluation says so

This is the single most consistent finding across all five evaluations, expressed differently in each:

• SB "Mixed success in fostering effective public/private engagement to improve the business environment." Only 3 reformed laws in 6 years.
• SIIP "Significant capacity gaps in policy and infrastructure delivery within SIG." SIG was supposed to provide an approved infrastructure pipeline; "no such agreed pipeline existed."
• J&G "The more ambitious and transformational objectives (a capable and responsive public service, reduced numbers of prisoners on remand, improved access to justice for citizens) are showing little or no progress."
• UW "A net operating surplus becomes a deficit once donor contributions are deducted." Solomon Water cannot sustain outcomes without ongoing external support.
• PFBS "Joint policy operations were not highly functional" in Solomon Islands at the time of investment.

2. Transactional reforms work; transformational ones don't

The Justice evaluation states it most directly: "transactional governance objectives are on track (PFM, a growing cadre of finance personnel, increasingly institutionalised and stronger budgeting process) whereas the more ambitious and transformational objectives... are showing little or no progress."

The same pattern repeats:

• SB Delivered 500 households with income increases, 117 FTE jobs, 44 partnerships (transactional). But only 3 laws initiated — "limited systemic change" (transformational).
• SIIP Capacity building progressing (EOPO1). Actual infrastructure delivery slow (EOPO2 — requires government systems to work).
• UW Service connections increased, financial stabilisation achieved. Institutional culture change incomplete.

3. VfM frameworks are systematically absent

Two independent evaluations, different programs, different years, different evaluators — the same finding:

• SB (2023): "No routine VfM reporting — a gap the evaluators flagged."
• SIIP (2024): "It is recommended that SIIP Hub prepare a VfM Framework using DFAT's existing VfM criteria."

4. Disability inclusion is the weakest GEDSI dimension

Across every program where disability data is reported:

• SB 0 jobs created for PWD since inception (vs 48 women, 75 youth). Only 13 PWD reached in capacity building (vs 881 women, 321 youth).
• PFBS Solomon Islands rated "Poor" on disability equity — the lowest category.
• J&G Disability not separately reported — itself a gap.

5. Risk management approaches diverge — and both create problems

6. Reporting focuses on inputs and activities, not outcomes

• J&G "Six monthly reports focus on reporting inputs, activities, and outputs. Limited linkage made to Outcomes."
• SB VfM not systematically reported. Evaluators had to reconstruct cost-effectiveness from program data.
• SIIP MEL "of high quality" from SIIP Hub, but recommendation for "higher level reporting on DFAT-led initiatives."

7. The twinning/embedded adviser model works for specific functions

• J&G "Embedded advisor model enables strategic support to change-makers at the right time. Evidence that long-term twinning can make a difference (SICS)."
• J&G "Some evidence that in some areas twinning e.g. AOFM is proving effective and valued." But: "personal relationships dominate" and "it may be impossible for nationals to speak truth to power."

Implications for Strongim Ekonomi (DFAT-1100)

Strongim Ekonomi merges the private sector mandate (Strongim Bisnis) with governance/PFM oversight under one managing contractor. The cross-evaluation synthesis reveals five specific risks and opportunities:

What makes this synthesis different

None of these insights appears in any single evaluation. Each evaluation assesses its own program against its own objectives. The cross-cutting patterns — the structural government capacity constraint, the transactional/transformational divide, the VfM gap, the disability failure, the risk management divergence — only emerge from reading across the portfolio.

A bid team preparing for Strongim Ekonomi that reads only the Strongim Bisnis evaluation (the obvious source) would miss 6 of the 7 findings above. The cross-evaluation synthesis scored an 86% utility rate in testing (6 of 7 items decision-changing), compared to 50% for individual bid intelligence briefs.

FCDO has an evaluation search tool (EvalExplorer, built by Baobab Tech via the Frontier Tech Hub). DFAT — the largest funder in 9 of 14 Pacific countries, with AUD 14.2B in contracting since 2015 — has no equivalent.