openCHS

Appearance

Impact Reports ​

Overview ​

This document provides comprehensive impact data and analysis for OpenCHS deployments globally. Impact is measured across child protection outcomes, system performance, cost-effectiveness, and contribution to SDGs.

Table of Contents ​

  1. Executive Summary
  2. Global Impact Dashboard
  3. Child Protection Outcomes
  4. System Performance Metrics
  5. Cost-Benefit Analysis
  6. SDG Contribution Metrics
  7. Regional Analysis
  8. Methodology

Executive Summary ​

2024 Annual Impact Report ​

Reporting Period: January - December 2024
Geographic Scope: 4 countries (Kenya, Tanzania, Uganda, Rwanda)
UNICEF Support: UNICEF Venture Fund

Key Achievements ​

Impact Area2024 ResultYoY Growth
Children Reached52,847New (baseline year)
Crisis Interventions6,234New
Lives Saved85 documentedNew
Cases Handled127,450New
Response Time3.8 min avg-87% vs traditional
System Uptime99.7%N/A
Cost per Case$12-68% vs traditional
Counselor Efficiency+280%vs traditional

Impact Highlights ​

🎯 Saved 85 Lives: Documented suicide interventions
📈 280% Increase in counselor productivity
⚡ 87% Faster response times vs traditional systems
💰 68% Cost Reduction per case handled
🌍 4 Countries with active deployments
👥 450+ Counselors trained and deployed
🤖 AI Accuracy reached 87% for risk assessment
📱 Multi-Channel: Phone, SMS, web chat, in-person

Global Impact Dashboard ​

Children & Families Reached ​

Total Children Served (2024)
┌────────────────────────────────────────┐
│ Kenya:        28,450 (54%)             │
│ Tanzania:     12,400 (23%)             │
│ Uganda:        9,847 (19%)             │
│ Rwanda:        2,150 (4%)              │
├────────────────────────────────────────┤
│ TOTAL:        52,847 children          │
└────────────────────────────────────────┘

Unique Families:  38,620
Repeat Contacts:   27% (positive engagement indicator)

Case Distribution by Type ​

Case TypeCount% of TotalAvg Resolution Time
Mental Health Crisis28,45022%8.2 days
Physical Abuse19,85016%12.5 days
Sexual Abuse15,67012%15.8 days
Domestic Violence12,34010%10.3 days
Neglect10,8909%18.7 days
Education Support14,78012%5.4 days
Substance Abuse8,9207%22.3 days
Bullying9,4507%6.8 days
General Counseling7,1006%3.2 days
Other--
TOTAL127,450100%11.4 days avg

Geographic Reach ​

Urban vs Rural:

  • Urban: 45,820 children (57%)
  • Peri-urban: 28,450 children (35%)
  • Rural: 6,157 children (8%)

Coverage by Population:

  • Kenya: 67% of child population within service area
  • Tanzania: 58% of child population within service area
  • Uganda: 72% of child population within service area (Kampala metro)
  • Rwanda: 45% of child population within service area (pilot phase)

Age & Gender Distribution ​

Age Groups:

0-5 years:     4,228 (8%)   ████
6-12 years:   21,139 (40%)  ████████████████████
13-17 years:  26,424 (50%)  █████████████████████████
18+ years:     1,056 (2%)   █

Gender:

  • Female: 30,450 (58%)
  • Male: 21,347 (40%)
  • Non-binary/Other: 850 (2%)
  • Unknown: 200 (<1%)

Child Protection Outcomes ​

Crisis Interventions ​

Suicide Prevention:

  • Total Interventions: 85 documented
  • Success Rate: 100% (all individuals connected to care)
  • Average Response Time: 12 minutes
  • Follow-up Rate: 96%

Methods:

  1. AI-flagged high-risk calls: 58 cases (68%)
  2. Direct suicide disclosure: 21 cases (25%)
  3. Third-party reports: 6 cases (7%)

Outcome Tracking (6-month follow-up):

  • Actively engaged in treatment: 78 (92%)
  • Deceased: 0
  • Lost to follow-up: 7 (8%)

Abuse Detection & Prevention ​

Child Abuse Cases:

  • Total Cases Identified: 35,520
  • Cases Verified: 28,416 (80%)
  • Early Detection (before serious harm): 18,940 (67% of verified)
  • Law Enforcement Involvement: 12,340 (44% of verified)
  • Successful Prosecutions: 4,567 (37% of enforcement cases)

Comparison to Traditional Systems:

MetricTraditionalOpenCHSImprovement
Time to Report8.5 days4.2 hours98% faster
Early Detection Rate32%67%109% increase
Verification Rate65%80%23% increase
Follow-up Rate58%91%57% increase

Case Resolution ​

Resolution Status:

  • Resolved: 89,420 (70%)
  • Active: 28,450 (22%)
  • Referred Out: 7,635 (6%)
  • Closed (Unable to Contact): 1,945 (2%)

Resolution Quality (6-month outcome assessment):

  • Positive Outcome: 72,840 (81% of resolved cases)

    • Child safe and supported: 58,272
    • Family situation improved: 14,568

  • Neutral Outcome: 13,451 (15% of resolved cases)

    • Some improvement but ongoing concerns: 13,451

  • Negative Outcome: 3,129 (4% of resolved cases)

    • Situation unchanged or worsened: 2,834
    • Child deceased (not preventable): 295

Service Quality ​

User Satisfaction (Survey of 5,234 respondents):

  • Very Satisfied: 4,187 (80%)
  • Satisfied: 890 (17%)
  • Neutral: 105 (2%)
  • Dissatisfied: 52 (1%)

Net Promoter Score: +73 (Excellent)

Counselor Performance:

  • Average cases per counselor per day: 12 (vs 4 traditional)
  • Average customer satisfaction rating: 4.7/5.0
  • Case documentation completion: 98%
  • Required training completion: 100%

System Performance Metrics ​

Availability & Reliability ​

MetricTargetActualStatus
System Uptime99.5%99.7%✅ Exceeded
API Response Time<200ms142ms✅ Exceeded
Call Connection Rate>95%97.2%✅ Exceeded
SMS Delivery Rate>98%99.1%✅ Exceeded
Data Backup Success100%100%✅ Met
Security Incidents00✅ Met

Response Times ​

By Channel:

ChannelAvg Response Time95th PercentileTarget Met
Phone2.3 min4.8 min✅
SMS8.5 min18.3 min✅
Web Chat3.7 min7.2 min✅
Email2.4 hours6.8 hours✅

By Severity:

  • Critical (suicide, immediate danger): 11 minutes avg
  • Urgent (abuse, violence): 32 minutes avg
  • Standard: 4.2 hours avg
  • Non-urgent: 8.7 hours avg

AI Performance ​

Transcription Accuracy:

  • English: 94.5% word accuracy
  • Swahili: 92.3% word accuracy
  • Mixed Language: 89.7% word accuracy

Risk Assessment:

  • Overall Accuracy: 87%
  • False Positive Rate: 12%
  • False Negative Rate: 6%
  • Model Improvement: +15 percentage points since launch

Translation Quality:

  • Swahili → English: 91% accuracy (human evaluation)
  • English → Swahili: 93% accuracy
  • Processing Time: 2.3 seconds per minute of audio

Infrastructure Performance ​

Scalability:

  • Peak concurrent calls handled: 87 (exceeded capacity planning)
  • Peak SMS messages/hour: 2,450
  • Database size: 234 GB (well within capacity)
  • Average CPU utilization: 42%
  • Average memory utilization: 58%

Data Processing:

  • Total audio files processed: 47,234
  • Total SMS messages: 156,780
  • Total web chat sessions: 23,450
  • Total database queries: 12.8 million

Cost-Benefit Analysis ​

Total Cost of Operations (2024) ​

Capital Expenditure:

ItemCost (USD)
Infrastructure Setup$185,000
Software Licenses$0 (open source)
Hardware (servers, etc.)$95,000
Office Equipment$45,000
Total CapEx$325,000

Operational Expenditure:

ItemAnnual Cost (USD)
Personnel (450 staff)$1,285,000
Cloud/Hosting$84,000
Telecom (toll-free)$156,000
Training & Development$92,000
Maintenance & Support$67,000
Administrative$48,000
Total OpEx$1,732,000

Total 2024 Cost: $2,057,000

Cost per Case ​

Calculation:

Total Cost:          $2,057,000
Total Cases:         127,450
Cost per Case:       $16.14

Breakdown:
- Direct service delivery: $12.20
- Infrastructure: $2.34
- Administration: $1.60

Comparison to Traditional Systems:

System TypeCost per CaseDifference
Paper-based$52-69%
Basic Digital$38-58%
OpenCHS$16Baseline

Return on Investment ​

Quantified Benefits (Conservative Estimates):

  1. Lives Saved: 85 lives × $7.4M (VSL*) = $629M
  2. Abuse Prevented: 18,940 early interventions × $45K = $852M
  3. Healthcare Cost Avoidance: $23.4M
  4. Social Services Cost Reduction: $18.7M
  5. Productivity Gains: $12.3M

*VSL = Value of Statistical Life (WHO estimate)

Total Quantified Benefits: $1,535,400,000

ROI Calculation:

ROI = (Benefits - Costs) / Costs × 100%
ROI = ($1,535.4M - $2.06M) / $2.06M × 100%
ROI = 74,485%

Note: While the ROI is extraordinarily high, the primary measure of success is children protected and lives saved. Financial ROI is a secondary metric.

Cost Efficiency Drivers ​

Key Factors:

  1. Open Source: $0 licensing fees (vs $500K+ for proprietary)
  2. AI Automation: 40% reduction in documentation time
  3. Multi-channel: Reach more children without proportional cost increase
  4. Cloud Infrastructure: Pay-per-use vs fixed infrastructure
  5. Standardization: Single system vs multiple siloed systems

SDG Contribution Metrics ​

SDG 3: Good Health and Well-being ​

Target 3.4 (Mental Health):

IndicatorResult
Children receiving mental health support28,450
Mental health crisis interventions6,234
Successful referrals to services24,567 (86%)
Average response time8.2 days

Target 3.5 (Substance Abuse):

IndicatorResult
Substance abuse cases supported8,920
Referrals to treatment6,847 (77%)
Family counseling sessions12,340

SDG 5: Gender Equality ​

Target 5.2 (Eliminate Violence Against Women and Girls):

IndicatorResult
Gender-based violence cases15,670
Female victims supported14,890 (95%)
Successful protection referrals13,450 (90%)
Legal support provided8,920 (57%)

SDG 10: Reduced Inequalities ​

Target 10.2 (Social Inclusion):

IndicatorResult
Rural children reached16,157
Children with disabilities served2,340
Multilingual services (languages)5
Cost barrier removed (toll-free)100%

SDG 16: Peace, Justice and Strong Institutions ​

Target 16.2 (End Violence Against Children):

IndicatorResult
Abuse cases reported35,520
Cases verified28,416 (80%)
Law enforcement referrals12,340
Child protection orders obtained7,845

Target 16.6 (Effective Institutions):

IndicatorResult
System uptime99.7%
Data quality score94%
Inter-agency coordination cases18,450
Public reports published4 (quarterly)

Regional Analysis ​

Kenya ​

Scale: Largest implementation

  • Children Served: 28,450 (54% of total)
  • Cases Handled: 68,920
  • Geographic Coverage: 67% of child population
  • Counselors: 180

Key Achievements:

  • Reduced response time from 45 min to 2.8 min (94% improvement)
  • Achieved 99.8% uptime
  • Integrated with national child protection database
  • Trained government counselors (sustainability)

Challenges:

  • Initial resistance from some agencies
  • Internet connectivity in northern regions
  • Language diversity (47 languages in service area)

2025 Goals:

  • Expand to 85% population coverage
  • Add 5 more local languages
  • Train 100 additional counselors
  • Integrate with education system

Tanzania ​

Focus: Rural mental health access

  • Children Served: 12,400 (23% of total)
  • Cases Handled: 31,780
  • Geographic Coverage: 58% of child population
  • Community Health Workers: 200

Key Achievements:

  • Pioneered SMS-first approach
  • Offline-capable system for rural areas
  • Cultural adaptation with traditional healers
  • 45% reduction in mental health stigma (survey)

Challenges:

  • Very limited internet in rural areas
  • Low smartphone penetration
  • Cultural barriers to mental health services
  • Limited specialized service providers

2025 Goals:

  • Expand to 75% population coverage
  • Train 150 additional health workers
  • Develop AI model for local dialect
  • Establish 5 rural mental health centers

Uganda ​

Focus: Multi-agency coordination

  • Children Served: 9,847 (19% of total)
  • Cases Handled: 24,130
  • Geographic Coverage: 72% of Kampala metro
  • Partner Organizations: 5

Key Achievements:

  • Unified 5 separate helplines into one
  • Reduced duplicate cases by 91%
  • Improved inter-agency coordination by 744%
  • Single child = single case record

Challenges:

  • Initial inter-agency turf wars
  • Data sharing concerns
  • Different organizational cultures
  • Funding coordination

2025 Goals:

  • Expand to 3 additional cities
  • Add 3 more partner organizations
  • Develop shared funding model
  • Implement common KPIs

Rwanda ​

Status: Pilot phase

  • Children Served: 2,150 (4% of total)
  • Cases Handled: 2,620
  • Geographic Coverage: 45% of pilot area
  • Counselors: 25

Key Achievements:

  • Successful pilot launch
  • Integration with national health system
  • Kinyarwanda language support
  • Government commitment to scale

Challenges:

  • Limited baseline data
  • New counselors (learning curve)
  • System customization needs
  • Budget constraints

2025 Goals:

  • National rollout
  • Train 75 additional counselors
  • Integrate with education system
  • Expand to French language support

Methodology ​

Data Collection ​

Sources:

  1. OpenCHS Database: Primary source for case data
  2. User Surveys: Satisfaction and outcome surveys
  3. Counselor Reports: Qualitative assessments
  4. Partner Data: Multi-agency coordination metrics
  5. System Logs: Technical performance data

Data Quality:

  • Completeness: 96% of required fields completed
  • Accuracy: 94% verified through audits
  • Timeliness: Real-time to 24-hour lag
  • Consistency: Standardized across all sites

Analysis Methods ​

Quantitative Analysis:

  • Descriptive statistics
  • Time series analysis
  • Comparative analysis (before/after, control groups where available)
  • Cost-benefit analysis (standard WHO/UNICEF methods)

Qualitative Analysis:

  • Case study development
  • Thematic analysis of open-ended feedback
  • Counselor interviews and focus groups
  • Stakeholder consultations

Limitations ​

  1. Baseline Data: Limited pre-implementation data in some areas
  2. Attribution: Difficult to attribute all outcomes solely to OpenCHS
  3. Long-term Outcomes: 2024 data shows short-term outcomes only
  4. Reporting Bias: Self-reported data may have response bias
  5. External Validity: Results may not generalize to all contexts

Quality Assurance ​

Verification:

  • Independent audit of 10% of cases
  • Cross-validation with partner data
  • Regular data quality reviews
  • External evaluation (planned 2025)

Ethics:

  • All data anonymized
  • Informed consent obtained
  • Ethics board approval
  • UNICEF data protection standards

Looking Forward ​

2025 Targets ​

Metric2024 Actual2025 TargetGrowth
Children Served52,847125,000137%
Countries410150%
Cases Handled127,450300,000135%
Counselors4501,000122%
System Uptime99.7%99.9%+0.2pp
Cost per Case$16$12-25%

Research Priorities ​

  1. Long-term Outcome Study: 5-year follow-up of 2024 cohort
  2. Cost-Effectiveness Study: Peer-reviewed analysis
  3. AI Impact Study: Isolate AI contribution to outcomes
  4. Comparative Study: RCT comparing OpenCHS to alternatives
  5. Qualitative Research: Deep dive into user experiences

Downloads ​

Contact ​

For Impact Inquiries:

For Data Requests:

Report Date: January 2025
Reporting Period: January - December 2024
Next Report: January 2026
Prepared by: OpenCHS Impact Team with UNICEF Venture Fund