Site Search

Site search refers to the indexing of detailed information of various entities, enabling the ability to search for relevant information within the current workspace from a single location in the system.

Searchable Entities

The following entities can be searched after indexing:

Project

Index Items

• Project name
• Project description

Associated Primary Key

• Project ID

Repository

Index Items

• Repository name
• Repository description
• Repository tags
• Repository source language

Associated Primary Key

• Repository ID

Order

Index Items

• Order supplier name
• Order corresponding repository name

Associated Primary Key

• Order ID

User

Index Items

• User nickname
• User email

Associated Primary Key

• User ID

Elasticsearch Indexing Scheme

Canal + MySQL Binlog Data Synchronization Scheme

Architecture Overview

Using Canal to capture MySQL Binlog changes, data is synchronized to Elasticsearch in real-time, ensuring consistency between search indexes and the database.

+-------------+     +------------+     +----------------+     +------------------+
|             |     |            |     |                |     |                  |
|   MySQL     +---->+   Canal    +---->+   Kafka/MQ     +---->+  Elasticsearch   |
|             |     |            |     |                |     |                  |
+-------------+     +------------+     +----------------+     +------------------+
     Binlog          Parse Binlog       Message Queue          Index Storage
                                        Buffer Layer           and Search