Newsreader Architecture

​

System Architecture

elata-vsm-system-4/
├── scraper/         # AI-powered news aggregation engine
├── web/             # Next.js frontend
└── shared-types/    # Zod schemas and shared TypeScript types

​

Scraper Pipeline

​

Phase 1: Aggregation

• NewsAPI queries for neuroscience, psychiatry, BCI, DeSci, and related keywords
• Web scraper fetches from 400+ curated sources: journals, preprint servers, pharma outlets, neurotech companies, regulatory agencies, and community platforms

​

Phase 2: Analysis

• GPT processor evaluates each article against the Elata mission and assigns a relevance score (0-1)
• GPT validator filters out low-quality or irrelevant content
• Tag assignment applies from a controlled vocabulary of 86 domain-specific tags across categories: neuroscience, hardware, AI/ML, pharmacology, biohacking, biomarkers, DeSci, and industry

​

Phase 3: Enrichment and Output

• Content scraper extracts full text, word count, and reading time
• Embedding generation via OpenAI for semantic search
• Podcast generation produces AI-narrated audio summaries using ElevenLabs with two narrator personas (Nova and Dr. Renn)
• Discord notifications alert the community to high-relevance articles
• Results are written to current.json and served via the REST API

​

Data Model

const ArticleSchema = z.object({
  id: z.string(),
  title: z.string(),
  url: z.string(),
  source: z.string(),
  description: z.string(),
  summary: z.string().optional(),
  tags: z.array(NewsTagSchema).default([]),
  relevanceScore: z.number(),
  author: z.string().optional(),
  publishedAt: z.string().optional(),
  scrapedAt: z.string(),
  sourceType: z.enum(["newsapi", "scrape", "twitter", "reddit", "community"]).optional(),
  embedding: z.array(z.number()).optional(),
  // ... additional fields
});

const SummaryMetadataSchema = z.object({
  totalArticles: z.number(),
  dateRange: z.object({ from: z.string(), to: z.string() }),
  tagCounts: z.record(z.string(), z.number()),
  sourceCounts: z.record(z.string(), z.number()),
});

​

Tag Taxonomy

​

Running Locally

git clone https://github.com/Elata-Biosciences/elata-vsm-system-4.git
cd elata-vsm-system-4

• Scraper setup
• Web platform setup