viniciusgadea
653d4f53b5
FEAT: Add optional 'docs' field to IDataAsset, IUpdateDataRequest, and ICreateDataAsset
2025-12-18 16:16:00 -03:00
Rafael Moraes
ea44a1cbb6
FEAT: Manual/Auto filter and UX Adjusments
2025-12-16 20:52:28 +00:00
Rafael Moraes
fc9c0b0991
WIP: Filtro Source - backend
2025-12-16 20:13:20 +00:00
Rafael Moraes
a4b5a44e44
Merge branch 'feature/catalog-update' of github.com:dadosfera/maestro into feature/catalog-update
2025-12-16 20:01:19 +00:00
Rafael Moraes
d99a6aa322
Merge branch 'beta' of github.com:dadosfera/maestro into feature/catalog-update
2025-12-16 19:58:48 +00:00
Rafael Santana
3f910f851a
Merge pull request #411 from dadosfera/fix/redis-tls-configurable
...
Fix/redis tls configurable
2025-12-16 16:58:41 -03:00
Rafael Moraes
bd231382eb
WIP: adiciona parâmetro asset_type no docsfera.json
2025-12-16 19:58:38 +00:00
Rafael
295f1f86ca
Merge branch 'fix/redis-tls-configurable' of github.com:dadosfera/maestro into fix/redis-tls-configurable
2025-12-16 16:57:59 -03:00
Rafael
0a5e8001f9
UPDATE: adding platform_api_url
2025-12-16 16:57:25 -03:00
Rafael Santana
9c1979e17a
Merge pull request #405 from dadosfera/fix/redis-tls-configurable
...
Fix/redis tls configurable
2025-12-16 16:41:04 -03:00
Rafael Santana
b2700d4bb0
Merge branch 'beta' into fix/redis-tls-configurable
2025-12-16 16:39:11 -03:00
Rafael and Claude Opus 4.5
01c1087e07
FEAT: add schedule limit validation and improve ES update
...
- Add schedule limit validation against customer's scheduleLimit from DUC
- Improve ES update to only update provided fields
- Mark GET /platform/pipeline/:pipelineId/pipeline_run as READY
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com >
2025-12-16 16:37:33 -03:00
viniciusgadea
fcf7fb054e
FIX: Update searchDataAssets to handle owner filtering and convert owner names to IDs
2025-12-16 09:55:24 -03:00
viniciusgadea
288aaeabc0
FIX: Enhance filter handling in BuildDataAssetsFilterTerms to support empty owner condition
2025-12-15 12:00:50 -03:00
viniciusgadea
918c3d7416
FIX: Enhance searchDataAssets to convert owner names to IDs and log the conversion
2025-12-15 09:08:08 -03:00
vinicius gadea
7dedb3bd33
Merge pull request #409 from dadosfera/feature/catalog-update
...
FIX: Simplify searchDataAssets by owner logging and remove log code
2025-12-12 15:51:17 -03:00
viniciusgadea
1ff5589a2e
FIX: Simplify searchDataAssets by owner logging and remove log code
2025-12-12 15:03:43 -03:00
Rafael Moraes
d24e9a1d80
Merge pull request #408 from dadosfera/feature/catalog-update
...
FIX: Calendar Fix
2025-12-11 22:26:25 +00:00
Rafael Moraes
7d3ef1ef92
FIX: Conflit resolution
2025-12-11 22:25:42 +00:00
Rafael Moraes
df3f2489f9
FIX: Calendar Fix
2025-12-11 22:10:32 +00:00
Rafael Moraes
53245b0067
Merge pull request #407 from dadosfera/feature/catalog-update
...
FIX: correção no validate k8s
2025-12-11 16:50:11 +00:00
Rafael Moraes
dd699614ae
FIX: Maestro helm fix
2025-12-11 16:47:28 +00:00
Rafael Moraes
6919a2a8d0
FIX: helmfile diff plugin
2025-12-11 14:14:02 +00:00
Rafael Moraes
5c29e07450
FIX: helmfile
2025-12-11 14:07:04 +00:00
Rafael Moraes
00304262ba
FIX: wget change in helmfile
2025-12-11 13:52:58 +00:00
vinicius gadea
bc931c6dd8
Merge pull request #406 from dadosfera/feature/catalog-update
...
catalogo: alteracao nas pastas e acrescimo de filtros
2025-12-11 09:18:57 -03:00
Rafael Moraes
c444d6e956
Merge pull request #404 from dadosfera/feat/add-docs-assets
...
Feat/add docs assets
2025-12-10 19:42:42 +00:00
Rafael and Claude Opus 4.5
f7efb757bf
FEAT: add schedule limit validation and improve ES update
...
- Add cron-validation utility with Airflow presets support (@once, @daily, etc.)
- Validate cron expressions against customer scheduleLimit from DUC
- Fetch scheduleLimit via gRPC to ensure up-to-date configuration
- Improve ES updatePipeline to fetch current doc and merge changes
- Only update fields explicitly provided in PATCH request body
- Preserve config.tables when updating config.cron
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com >
2025-12-10 13:56:49 -03:00
Rafael Moraes
2f140d213a
catalogo: alteracao nas pastas e acrescimo de filtros
2025-12-10 16:51:28 +00:00
Rafael and Claude Opus 4.5
df674dd441
FEAT: add Platform API proxy with Elasticsearch and DynamoDB sync
...
- Add Platform API module to proxy requests to Platform API service
- Add Elasticsearch service for pipeline catalog sync (CRUD operations)
- Add DynamoDB service for storing pipeline tables/inputs configuration
- Sync pipeline creation/update/delete to Elasticsearch index
- Extract tables from jobs with connector-specific mappings:
- JDBC: table_name, load_type, column_include_list, incremental_column_name
- Singer: replication_method -> full_load/incremental
- S3: same as Singer
- Map connector types to DynamoDB types (jdbc->database, singer->application, s3->file)
- Validate connector type is provided in job input
- Normalize pipeline IDs for Platform API (replace - with _), keep UUIDs for ES
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com >
2025-12-10 12:42:18 -03:00
viniciusgadea
09dced9fcd
REFACTOR: add asset_type query parameter to getDataDocs and separate data docs methods
2025-12-10 11:21:46 -03:00
viniciusgadea
165b533172
FIX: removing unnecessary type parameter from GetDatasetDoc call
2025-12-10 11:17:43 -03:00
viniciusgadea
b1dc567394
DOCS: update @dadosfera/protospack-v2 to version 3.38.0-beta.16
2025-12-10 11:12:13 -03:00
viniciusgadea
a0a1303515
DOCS: add automatic asset_type query parameter to API schema and packages dependencies
2025-12-09 14:56:51 -03:00
viniciusgadea
c21d977f7c
FEAT: enhance catalog service to support any asset type in data docs creation
2025-12-09 14:56:51 -03:00
viniciusgadea
399d3492d3
DOCS: update @dadosfera/protospack-v2 to version 3.38.0-beta.15
2025-12-09 14:56:51 -03:00
Marcos Rodrigues Silva
b0b557246e
Merge pull request #403 from dadosfera/feat/user-properties
...
FIX: change origin to host
2025-12-03 15:26:10 -03:00
Marcos Rodrigues
bb671a90d6
FIX: change origin to host
2025-12-03 15:20:41 -03:00
Marcos Rodrigues Silva
f6ababbe7a
Merge pull request #402 from dadosfera/feat/user-properties
...
FIX: using header host
2025-12-03 14:46:14 -03:00
Marcos Rodrigues
82290285d0
FIX: using header host
2025-12-03 14:41:51 -03:00
Marcos Rodrigues Silva
c490814a98
Merge pull request #401 from dadosfera/feat/user-properties
...
FEAT: add resource origin validate in me endpoint
2025-12-03 13:53:33 -03:00
Marcos Rodrigues
7616b1e32c
FEAT: add resource origin validate in me endpoint
2025-12-03 13:51:32 -03:00
Rafael Santana
3ba2c91893
Merge pull request #400 from dadosfera/fix/redis-tls-configurable
...
UPDATE: force deployment
2025-12-02 15:30:03 -03:00
Rafael
e789076ed4
UPDATE: force deployment
2025-12-02 15:29:36 -03:00
Rafael Santana
3b6ddaaee6
Merge pull request #399 from dadosfera/fix/redis-tls-configurable
...
fix: make Redis TLS configurable via REDIS_TLS env var
2025-12-02 15:18:05 -03:00
Rafael and Claude
8073194604
fix: make Redis TLS configurable via REDIS_TLS env var
...
- Change TLS check from ENV !== 'local' to REDIS_TLS === 'true'
- Add REDIS_TLS env var to Helm deployment template
- Default to true for OCI Redis, can override for self-hosted K8s
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-12-02 15:10:31 -03:00
Marcos Rodrigues Silva
cd2c53b5c5
Merge pull request #398 from dadosfera/feat/user-properties
...
FIX: user response
2025-12-01 17:36:56 -03:00
Marcos Rodrigues
adf1b3b97e
FIX: user response
2025-12-01 17:30:37 -03:00
Marcos Rodrigues Silva
d84b5e184b
Merge pull request #397 from dadosfera/feat/user-properties
...
FEAT: include more user info in /me
2025-12-01 12:36:16 -03:00
Marcos Rodrigues
6d608a0457
FEAT: include more user info in /me
2025-12-01 12:26:33 -03:00
viniciusgadea