NYS RENEWABLE
INTELLIGENCE
  • Dashboard
  • Night Desk
  • Projects
  • Opposition Monitor
  • Actors
  • Funding Network
  • Disinformation
  • Legislation
  • Knowledgebase
  • Counter-Measures
  • Reports
  • Map
  • Data Explorer
  • Admin

Quick Search

Platform Administration

Connectors, pipeline health, access control and the settings behind the knowledgebase.

8
All systems operational2 connectors need attentionv0.9.4 · deployed 2 days ago

Records

17,208412

Across 10 tables

Storage Used

184 GB6%

142 GB docs · 42 GB DB

Active Users

313

8 signed in today

Ingestion Jobs Today

384

34 ok · 3 warned · 1 failed

Data Freshness

6 min12%

Median connector lag

Data Sources9 connectors · 3 need attentionEvery ingestion connector feeding the warehouse, with its schedule, health and manual controls.Every ingestion connector feeding the warehouse, with its schedule, health and manual controls.

ORES Docket System

Scraper · Playwright

Healthy

All 132 active dockets and their intervenor lists.

Schedule
Every 4 hours
Last run
12 min ago
Next run
in 3h 48m
Records
6,742

NYS DOS Local Law Database

Scraper · HTTP

Healthy

Keyword filter: solar, battery, storage, moratorium.

Schedule
Weekly · Mon 02:00
Last run
2 days ago
Next run
in 5d 6h
Records
418

ProPublica Nonprofit Explorer API

REST API

Degraded

Rate limited twice overnight; 14 EINs deferred.

Schedule
Daily · 01:30
Last run
9 hours ago
Next run
in 15h
Records
2,106

NYS Board of Elections

Bulk CSV

Healthy

Campaign finance for town board members.

Schedule
Monthly · 1st
Last run
11 days ago
Next run
in 19d
Records
3,910

Local News RSS Monitor

RSS · 84 feeds

Healthy

Watertown Times, Post-Star, Finger Lakes Times +81.

Schedule
Every 15 min
Last run
4 min ago
Next run
in 11m
Records
12,844

Facebook Group Monitor

Headless browser

Failing

Session cookie rejected on 3 of 26 groups.

Schedule
Every 6 hours
Last run
5 hours ago
Next run
in 1h 12m
Records
9,317

Town Minutes OCR

Tesseract + LLM cleanup

Healthy

PDF minutes from 214 towns, 96% OCR confidence.

Schedule
Nightly · 03:00
Last run
13 hours ago
Next run
in 11h
Records
894

IRS 990 Bulk Download

S3 sync + XML parse

Paused

Paused until the 2024 filing season index is posted.

Schedule
Quarterly
Last run
24 days ago
Next run
—
Records
1,284

Municipal Hearing Calendars

iCal + scraper

Healthy

Feeds the upcoming hearings board on the dashboard.

Schedule
Every 12 hours
Last run
3 hours ago
Next run
in 9h
Records
606

Pipeline Run History13 recent runsEvery scheduled and manual ingestion run. Expand a row to read the job log.Every scheduled and manual ingestion run. Expand a row to read the job log.

ConnectorStartedDurationRecordsWarnErrStatus
Local News RSS MonitorToday 16:4238s21400Success
ORES Docket SystemToday 16:344m 12s9120Warning
Facebook Group MonitorToday 12:101m 06s003Failed
12:10:04 loading session for 26 monitored groups
12:10:41 ERROR checkpoint challenge on group 'Stop Sullivan Solar'
12:10:52 ERROR checkpoint challenge on group 'Protect Orange County'
12:11:03 ERROR checkpoint challenge on group 'Save Our Ridgelines'
12:11:10 aborting run · 3 of 26 groups unreachable
Municipal Hearing CalendarsToday 13:5852s1810Warning
Town Minutes OCRToday 03:0027m 41s6340Warning
ProPublica Nonprofit Explorer APIToday 01:306m 18s14220Warning
ORES Docket SystemToday 12:343m 49s7400Success
Local News RSS MonitorToday 12:2734s18700Success
NYS DOS Local Law DatabaseMon 02:008m 03s2610Warning
Municipal Hearing CalendarsYesterday 21:5849s1100Success
Facebook Group MonitorYesterday 18:109m 27s34130Warning
NYS Board of ElectionsMay 18 04:0014m 55s3,91000Success
IRS 990 Bulk DownloadMay 5 06:0041m 12s1,28420Warning

Data Quality503 open itemsAutomated integrity checks run after every ingestion batch. Queue a check to send it to the resolution worklist.Automated integrity checks run after every ingestion batch. Queue a check to send it to the resolution worklist.

last audit 14 min ago

  • Duplicate entitiesHigh

    Organizations sharing an EIN or a normalized name

    organizations6 vs. last week

    47

  • Unresolved aliasesMedium

    Individual name variants awaiting a merge decision

    individuals11 vs. last week

    132

  • Missing county assignmentHigh

    Filings with no resolvable municipality or FIPS code

    filings3 vs. last week

    28

  • Stale funding recordsLow

    Flows whose newest supporting 990 is older than 3 years

    funding_flows4 vs. last week

    214

  • Low-confidence extractionsMedium

    OCR or LLM extractions below the 0.80 confidence floor

    filings9 vs. last week

    63

  • Hearings without a project linkLow

    Calendar entries the resolver could not match to a docket

    hearings7 vs. last week

    19

Users & Roles10 of 10Role-based access: Admins manage connectors and keys, Analysts and Researchers query, Developers hold API scopes, Read-only partners see published views.Role-based access: Admins manage connectors and keys, Analysts and Researchers query, Developers hold API scopes, Read-only partners see published views.

  • JDJane Doejane.doe@nysri.orgNYSRI ResearchAnalyst2 min agoactive
  • MRMarcus Ruizm.ruiz@nysri.orgNYSRI PlatformAdmin18 min agoactive
  • PRPriya Ramanp.raman@cleanpathny.orgCleanPath NYResearcher1 hour agoactive
  • TOTom Okonkwot.okonkwo@hudsonridge.comHudson Ridge RenewablesAnalyst3 hours agoactive
  • SBSofia Bergströmsofia@empiregrid.ioEmpire Grid StorageRead-onlyyesterdayactive
  • DWDaniel Wexlerd.wexler@nysri.orgNYSRI PlatformDeveloperyesterdayactive
  • ACAisha Colemana.coleman@nyserda.ny.govNYSERDA (observer)Read-only3 days agoactive
  • GHGrant Halvorsengrant@lakeshore-energy.comLakeshore EnergyAnalyst4 days agosuspended
  • RCRenee Castellanor.castellano@nysri.orgNYSRI ResearchResearcher6 days agoactive
  • OFOwen Fitzgeraldowen.f@steubensolar.comSteuben Solar DevelopmentRead-onlypendinginvited

System Settingsmodels & retentionApplies to the LLM interface, the embedding pipeline and the raw document retention policy.Applies to the LLM interface, the embedding pipeline and the raw document retention policy.

LLM model

Drives natural language queries and argument classification.

Embedding model

Re-indexing 6,742 documents takes about 40 minutes.

Raw document retention

How long source PDFs stay in object storage before archival.

Changes apply to new jobs only.

Alert Thresholds4 rulesThresholds that decide when the monitor raises an alert on the dashboard and by email.Thresholds that decide when the monitor raises an alert on the dashboard and by email.

  • Model-language similarity

    88%

    Alert when a filed local law matches model text above this score

  • Narrative surge

    12 items

    New disinformation items in a county within 24 hours

  • Funding flow floor

    25K USD

    Notify on newly traced grants at or above this amount

  • Hearing lead time

    7 days

    Days of notice before a tracked hearing triggers a briefing

API Keys4 activeKeys are stored hashed; the plaintext shown here is only available to Admins.Keys are stored hashed; the plaintext shown here is only available to Admins.

  • Production — Web UI

    read:all

    created Jan 14, 2025·last used 2 min ago

  • LLM function-calling gateway

    read:all, search:documents

    created Feb 02, 2025·last used 9 min ago

  • Partner — CleanPath NY

    read:counties, read:projects

    created Mar 28, 2025·last used yesterday

  • Ingestion writer

    write:filings, write:narratives

    created Apr 11, 2025·last used 4 min ago