Stay on top of trending topics on social media — all in one place.

Trend Finder collects and analyzes posts from key influencers, then sends a Slack notification when it detects new trends or product launches. This has been a complete game-changer for the @firecrawl_dev marketing team by:

• Saving time normally spent manually searching social channels
• Keeping you informed of relevant, real-time conversations
• Enabling rapid response to new opportunities or emerging industry shifts

Spend less time hunting for trends and more time creating impactful campaigns.

1. Data Collection 📥

   • Monitors selected influencers' posts on Twitter/X using their API
   • Uses Firecrawl to gather additional web data and context
   • Runs on a scheduled basis using cron jobs

2. AI Analysis 🧠

   • Processes collected content through Together AI
   • Identifies emerging trends and patterns
   • Detects product launches and significant conversations
   • Analyzes sentiment and relevance

3. Notification System 📢

   • When significant trends are detected, sends instant Slack notifications
   • Provides context about the trend and its sources
   • Enables quick response to emerging opportunities

4. Practical Example 💡

   • Multiple tech influencers start discussing a new AI tool
   • Trend Finder detects this pattern in real-time
   • Your marketing team gets notified via Slack
   • You can quickly create content or engage with the trend early

• 🤖 AI-powered trend analysis using Together AI
• 📱 Social media monitoring (Twitter/X integration)
• 🔍 Firecrawl integration for enhanced data crawling
• 📊 Real-time trend detection and analysis
• 💬 Instant Slack notifications
• ⏱️ Scheduled monitoring using cron jobs
• 🎯 Express.js backend for reliable performance

• Runtime: Node.js with TypeScript
• Framework: Express.js
• AI/ML: Together AI
• Data Sources:
  • Twitter/X API
  • Firecrawl
• Notifications: Slack Webhooks
• Scheduling: node-cron
• Development:
  • nodemon for hot reloading
  • TypeScript for type safety
  • Express async handler for error management

• Node.js (v14 or higher)
• npm or yarn
• Docker
• Docker Compose
• Slack workspace with webhook permissions
• API keys for required services

Copy .env.example to .env and configure the following variables:

# Required: API key from Together AI for trend analysis (https://www.together.ai/)
TOGETHER_API_KEY=your_together_api_key_here

# Optional: API key for Firecrawl services - needed only if monitoring web pages (https://www.firecrawl.dev/)
FIRECRAWL_API_KEY=your_firecrawl_api_key_here

# Optional: Twitter/X API Bearer token - needed only if monitoring Twitter/X trends (https://developer.x.com/)
X_API_BEARER_TOKEN=your_twitter_api_bearer_token_here

# Required: Incoming Webhook URL from Slack for notifications
SLACK_WEBHOOK_URL=https://hooks.slack.com/services/YOUR/WEBHOOK/URL

1. Clone the repository:

   git clone [repository-url]
   cd trend-finder

2. Install dependencies:

   npm install

3. Configure environment variables:

   cp .env.example .env
   # Edit .env with your configuration

4. Run the application:

   # Development mode with hot reloading
   npm run start
   
   # Build for production
   npm run build

1. Build the Docker image:

   docker build -t trend-finder .

2. Run the Docker container:

   docker run -d -p 3000:3000 --env-file .env trend-finder

1. Start the application with Docker Compose:

   docker-compose up --build -d

2. Stop the application with Docker Compose:

   docker-compose down

trend-finder/
├── src/
│   ├── controllers/    # Request handlers
│   ├── services/       # Business logic
│   └── index.ts        # Application entry point
├── .env.example        # Environment variables template
├── package.json        # Dependencies and scripts
└── tsconfig.json       # TypeScript configuration

1. Fork the repository
2. Create your feature branch (git checkout -b feature/amazing-feature)
3. Commit your changes (git commit -m 'Add some amazing feature')
4. Push to the branch (git push origin feature/amazing-feature)
5. Open a Pull Request