Rafael
f48a35c7ce
UPDATE: improve logging for table metadata
2025-02-20 08:40:48 -03:00
Rafael
dc617b6925
REFACTOR: Improve logging with additional metadata
...
- Enhanced logs to include more detailed request body information.
- Standardized log calls to include extra metadata, such as service name, environment, customer name, user ID, HTTP method, and request path.
- Improved error logging to provide better debugging insights.
Example log format:
EXTRA[{"service":{"name":"maestro","environment":"stg"},"customer_name":"dadosfera","user_id":"047824d8-0021-709a-bf15-39b8dd069aaf","method":"POST","path":"/catalog/register-dataset"}]
Related tickets or issues: [TECN-9441]
2025-02-14 15:04:22 -03:00
Rafael
721232448e
FEAT: Enable dataset registration via API for external sources
...
As part of our hybrid approach, we need to allow dataset cataloging from outside our cloud environment.
Instead of relying on our GRPC APIs, we leveraged an existing REST API to handle this process.
- Updated Maestro to call Nimbus directly for dataset registration.
- Modified protospack to generate the necessary TypeScript interfaces.
- Added the `/catalog/register-dataset` endpoint to the API.
This change enables seamless dataset registration from external sources while maintaining compatibility with our existing infrastructure.
Related tickets or issues: [TECN-9441]
2025-02-14 10:08:45 -03:00
Gabriel Rosa
fd47a746af
FIX: microservices urls
2024-08-16 22:19:11 +00:00
Gabriel Rosa
5038c7845f
FEAT: dev docker
2024-08-16 21:59:23 +00:00
Gabriel Rosa
0119cee3c6
FIX: removed unused imports
2024-08-14 11:29:14 -03:00
Gabriel Rosa
c7e850cc79
FEAT: rls rules routes
2024-08-14 11:13:19 -03:00
Gabriel Rosa
5da47e5438
FEAT: create RLS on pi-factory
2024-08-07 18:16:20 -03:00
Gabriel Amorim
55281e3965
FIX: docs
2023-03-16 17:58:11 -03:00
Gabriel Amorim
7b0d4dd5bc
FIX: set route params type
2023-03-16 17:45:03 -03:00
Gabriel Amorim
7b25bfdb69
FIX: add table_schema to request
2023-03-14 16:00:57 -03:00
Gabriel Amorim
2abc19c589
FEAT: trigger and get dataset cataloging task
2023-03-14 13:39:21 -03:00
Gabriel Rosa
a4ff07a285
FIX: removed connection test from external docs
2023-02-16 12:07:47 -03:00
Gabriel Rosa
28578d3aa8
FIX: better query params on catalog get all
2023-02-15 16:46:32 -03:00
Gabriel Rosa
6a14c2b459
FIX: hide internal endpoints
2023-02-15 13:13:43 -03:00
Gabriel Rosa
a2c9a462e4
Run semantic release on manual deploy
2023-02-14 16:46:54 -03:00
Gabriel Rosa
de06512249
FIX: changed language strategy to use new custom decorator
2023-02-14 08:56:23 -03:00
Gabriel Rosa
9058b80383
Merge branch 'main' into feat/docs-refactor
2023-02-13 12:16:12 -03:00
Gabriel Rosa
d6b3e02890
FIX: automattically skip ssl when microservices connection are local
2023-02-13 10:30:50 -03:00
Gabriel Rosa
fbc0d2eede
FIX: moved decorators to a separate folder
2023-02-10 14:23:27 -03:00
Gabriel Rosa
9fcbeda470
FIX: deprecating old pipeline routes
2023-02-08 18:07:06 -03:00
Gabriel Rosa
8043635b1c
FIX: add authentication to swagger
2023-02-08 15:23:49 -03:00
Gabriel Rosa
b36ff624b5
FIX: add logic for fetching shared data_assets
2023-02-01 18:00:36 -03:00
Anderson Feitosa
b38e9f26c3
FEAT: add route to get data asset by pipeline and object
2022-12-22 17:00:56 -03:00
Gabriel Amorim
c83d8ab1b2
Merge branch 'main' into feat/embed-data-asset
2022-12-07 15:48:04 -03:00
Gabriel Rosa
21f68b466d
FIX: removed split on id on catalog POST docs route
2022-12-07 14:49:58 -03:00
Gabriel Rosa
6fdd73c58c
removing treatment of undefined embed field
2022-12-07 08:36:21 -03:00
Gabriel Rosa
1c0377a4fa
FIX: treat empty embed on update
2022-12-06 11:04:18 -03:00
Gabriel Rosa
64816e5578
FIX: treat empty embed
2022-12-06 10:07:30 -03:00
Gabriel Rosa
0b8bf9a535
Merge branch 'main' into feat/embed-data-asset
2022-12-06 09:09:43 -03:00
Gabriel Rosa
81d93ff103
FEAT: embed data asset
2022-12-05 13:22:23 -03:00
Gabriel Rosa
d55563f62f
FIX: removed split on data_asset id on DELETE route
2022-11-30 16:21:36 -03:00
Gabriel Rosa
ba9575c53e
FIX: return only owner username
2022-11-30 15:43:30 -03:00
Gabriel Rosa
d88b154d43
FIX: new id strategy for data assets
2022-11-30 15:29:31 -03:00
Gabriel Rosa
14c686cff4
FIX: renamed catalog create permission
...
- Catalog controller using permission decorator on every route
2022-11-14 15:40:38 -03:00
Victor Radael
2dc965ed90
FIX:delete and update data asset
2022-11-08 14:18:31 -03:00
Victor Radael
b2f1ce669d
FIX: Save
2022-11-08 11:41:34 -03:00
Gabriel Rosa
8fa924fdfb
Changed delete description
2022-11-04 09:27:53 -03:00
Victor Radael
4b4bdfea61
FEAT: Create Data Asset
2022-11-03 17:18:20 -03:00
Gabriel Rosa
af12a39959
FEAT: Deploy summary
2022-11-03 10:53:37 -03:00
Gabriel Rosa
fb0c659cd1
FIX: permissions for catalog
2022-11-03 10:27:50 -03:00
Gabriel Rosa
c029e286b5
WIP
2022-11-01 15:31:45 -03:00
Victor Radael
dfa6222538
FIX: Delete data asset
2022-10-26 14:22:29 -03:00
Victor Radael
d486231fd6
FEAT: RLS new barnch
2022-10-21 15:44:21 -03:00
Gabriel Rosa
7fbc919716
FIX: catalog filters
2022-10-20 11:23:30 -03:00
Gabriel Rosa
5b1eb19511
FIX: catalog sort by
2022-10-20 10:27:38 -03:00
Victor Radael
b714f3cf36
FIX: Filters
2022-10-20 10:04:45 -03:00
Victor Radael
48c1e29168
FIX: Filters
2022-10-20 09:45:12 -03:00
Victor Radael
04ea1d0f04
FIX: Get a total and fix owner type
2022-10-19 17:01:22 -03:00
Victor Radael
0de5e1d5d1
PATCH: Ref/Catalog new functions
2022-10-18 14:13:24 -03:00
Rafael