mirror of
https://github.com/dadosfera/maestro.git
synced 2026-11-22 15:59:09 +00:00
- Add Platform API module to proxy requests to Platform API service - Add Elasticsearch service for pipeline catalog sync (CRUD operations) - Add DynamoDB service for storing pipeline tables/inputs configuration - Sync pipeline creation/update/delete to Elasticsearch index - Extract tables from jobs with connector-specific mappings: - JDBC: table_name, load_type, column_include_list, incremental_column_name - Singer: replication_method -> full_load/incremental - S3: same as Singer - Map connector types to DynamoDB types (jdbc->database, singer->application, s3->file) - Validate connector type is provided in job input - Normalize pipeline IDs for Platform API (replace - with _), keep UUIDs for ES 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
6 lines
207 B
TypeScript
6 lines
207 B
TypeScript
export const ELASTICSEARCH_CONFIG = {
|
|
getUrl: () => process.env.ELASTICSEARCH_URL || 'http://localhost:9200',
|
|
getApiKey: () => process.env.ELASTICSEARCH_API_KEY || '',
|
|
timeout: 10000, // 10 seconds
|
|
};
|