REFACTOR: add asset_type query parameter to getDataDocs and separate data docs methods

FIX: removing unnecessary type parameter from GetDatasetDoc call
DOCS: update @dadosfera/protospack-v2 to version 3.38.0-beta.16
2026-11-07 08:09:07 +00:00 · 2025-12-10 11:21:46 -03:00 · 2025-12-10 11:17:43 -03:00 · 2025-12-10 11:12:13 -03:00 · 2025-12-09 14:56:51 -03:00 · 2025-12-09 14:56:51 -03:00
17 changed files with 350 additions and 1487 deletions
@@ -1,482 +0,0 @@
-# Maestro ↔ In-Factory Migration Map
-
-This document maps all integration points between Maestro and In-Factory that need to be addressed to remove the dependency.
-
-## Architecture Overview
-
-```mermaid
-graph TD;
-  Frontend<-->Maestro;
-  Maestro<-->DUC;
-  Maestro<-->pi-factory;
-  Maestro<-->in-factory;
-```
-
-Maestro connects to **3 external microservices**:
- **DUC** (`DUC_URL`) - User management, authentication, permissions
- **PI-Factory** (`PIFACTORY_URL`) - Pipelines, Catalog services
- **IN-Factory** (`INFACTORY_URL`) - Connections, Connectors, Inputs, Network Config, Transformations
-
---
-
-## Summary Table
-
-| Category | Count | Impact Level |
-|----------|-------|--------------|
-| gRPC Client Configurations | 6 | HIGH |
-| NestJS Modules | 6 | HIGH |
-| REST Controllers/Endpoints | 6 | HIGH |
-| Service Classes | 6 | HIGH |
-| Configuration Files | 5 | MEDIUM |
-| Proto Package Dependencies | 2 | HIGH |
-| Environment Variables | 2 | LOW |
-
---
-
-## 1. gRPC CLIENT CONFIGURATIONS (Files to Migrate)
-
-These files configure gRPC connections to In-Factory services:
-
-### 1.1 Connection Client (`INFACTORY_URL`)
-**File:** `src/modules/connection/client.config.ts`
-```typescript
-// Lines 10-11, 18
-process.env.INFACTORY_URL.startsWith('in-factory:')
-process.env.INFACTORY_URL.includes('0.0.0.0')
-url: process.env.INFACTORY_URL
-```
-**Proto Services Used:**
- `ConnectionManager.ProtoPackages.WritePackage`
- `ConnectionManager.ProtoPackages.ReadPackage`
-
-### 1.2 Connector Client (`INFACTORY_URL`)
-**File:** `src/modules/connector/client.config.ts`
-```typescript
-// Lines 10-11, 18
-url: process.env.INFACTORY_URL
-```
-**Proto Services Used:**
- `ConnectorManager.ProtoPackages.WritePackage`
- `ConnectorManager.ProtoPackages.ReadPackage`
-
-### 1.3 Inputs Client (`INFACTORY_URL`)
-**File:** `src/modules/inputs/inputs-client.config.ts`
-```typescript
-// Lines 10-11, 17
-url: process.env.INFACTORY_URL
-```
-**Proto Services Used:**
- `Input.ProtoPackages.WritePackage`
- `Input.ProtoPackages.ReadPackage`
-
-### 1.4 Network Config Client (`INFACTORY_URL`)
-**File:** `src/modules/network-config/network-config-client.config.ts`
-```typescript
-// Lines 10-11, 19
-url: process.env.INFACTORY_URL
-```
-**Proto Services Used:**
- `NetworkConfig.ProtoPackages.WritePackage`
- `NetworkConfig.ProtoPackages.ReadPackage`
-
-### 1.5 Connection Test Client (`INFACTORY_URL`)
-**File:** `src/modules/connection-test/connection-test-client.config.ts`
-```typescript
-// Lines 10-11, 17
-url: process.env.INFACTORY_URL
-```
-**Proto Services Used:**
- `ConnectionTest.ProtoPackages.ReadPackage`
-
-### 1.6 Transformations Client (`INFACTORY_URL`)
-**File:** `src/modules/transformations/transformations-client.ts`
-```typescript
-// Lines 10-11, 18
-url: process.env.INFACTORY_URL
-```
-**Proto Services Used:**
- `Transformation.ProtoPackages.WritePackage`
-
---
-
-## 2. SERVICE CLASSES (Business Logic to Migrate)
-
-### 2.1 Connection Client Service
-**File:** `src/modules/connection/client.service.ts`
-
-**gRPC Methods Called:**
-| Method | Service | Direction |
-|--------|---------|-----------|
-| `CreateConnection()` | ConnectionManagerWriteServices | Write |
-| `UpdateConnection()` | ConnectionManagerWriteServices | Write |
-| `DeleteConnection()` | ConnectionManagerWriteServices | Write |
-| `GetConnectionDetails()` | ConnectionManagerReadServices | Read |
-| `GetAllConnections()` | ConnectionManagerReadServices | Read |
-| `GetConnectorAvailableConnectionsByCustomer()` | ConnectionManagerReadServices | Read |
-| `ValidatePlatformConnections()` | ConnectionManagerReadServices | Read |
-
-**Key Methods:**
- `createConnection()`
- `updateConnection()`
- `deleteConnection()`
- `getConnections()`
- `getConnectionDetails()`
- `validatePlatformConnections()`
-
-### 2.2 Connector Client Service
-**File:** `src/modules/connector/client.service.ts`
-
-**gRPC Methods Called:**
-| Method | Service | Direction |
-|--------|---------|-----------|
-| `RegisterConnector()` | ConnectorManagerWriteServices | Write |
-| `UploadFile()` | ConnectorManagerWriteServices | Write |
-| `RegisterMultipleConnectorsWithoutImage()` | ConnectorManagerWriteServices | Write |
-| `UpdateConnectorByID()` | ConnectorManagerWriteServices | Write |
-| `DeleteConnectorById()` | ConnectorManagerWriteServices | Write |
-| `GetConnectors()` | ConnectorManagerReadServices | Read |
-
-### 2.3 Inputs Service
-**File:** `src/modules/inputs/inputs.service.ts`
-
-**gRPC Methods Called:**
-| Method | Service | Direction |
-|--------|---------|-----------|
-| `CreateInput()` | InputWriteService | Write |
-| `UpdateInput()` | InputWriteService | Write |
-| `DeleteInput()` | InputWriteService | Write |
-| `GetAvailableEntities()` | InputReadService | Read |
-
-### 2.4 Network Config Service
-**File:** `src/modules/network-config/network-config.service.ts`
-
-**gRPC Methods Called:**
-| Method | Service | Direction |
-|--------|---------|-----------|
-| `NetworkConfigCreate()` | NetworkConfigWriteService | Write |
-| `NetworkConfigUpdate()` | NetworkConfigWriteService | Write |
-| `NetworkConfigDelete()` | NetworkConfigWriteService | Write |
-| `NetworkConfigFindAll()` | NetworkConfigReadService | Read |
-| `NetworkConfigFindOneById()` | NetworkConfigReadService | Read |
-
-### 2.5 Connection Test Service
-**File:** `src/modules/connection-test/connection-test.service.ts`
-
-**gRPC Methods Called:**
-| Method | Service | Direction |
-|--------|---------|-----------|
-| `TestConnection()` | ConnectionTestReadService | Read |
-
-### 2.6 Transformations Service
-**File:** `src/modules/transformations/client.service.ts`
-
-**gRPC Methods Called:**
-| Method | Service | Direction |
-|--------|---------|-----------|
-| `CreateTransformation()` | TransformationWriteService | Write |
-| `UpdateTransformation()` | TransformationWriteService | Write |
-| `DeleteTransformation()` | TransformationWriteService | Write |
-| Various read operations | TransformationReadService | Read |
-
---
-
-## 3. NESTJS MODULES (Module Registration)
-
-These modules register the gRPC clients and export services:
-
-| Module | File | Imports | Exports |
-|--------|------|---------|---------|
-| ConnectionModule | `src/modules/connection/connection.module.ts` | ConnectionClientConfiguration | ConnectionClientService |
-| ConnectorModule | `src/modules/connector/connector.module.ts` | ConnectorClientConfiguration | ConnectorClientService |
-| InputsModule | `src/modules/inputs/inputs.module.ts` | InputsGrpcClient | InputsService |
-| NetworkConfigModule | `src/modules/network-config/network-config.module.ts` | NetworkConfigGrpcClient | NetworkConfigService |
-| ConnectionTestModule | `src/modules/connection-test/connection-test.module.ts` | ConnectionTestClientConfiguration | ConnectionTestService |
-| TransformationsModule | `src/modules/transformations/transformations.module.ts` | TransformationsClientConfiguration | TransformationsService |
-
-**App Module Registration:** `src/app.module.ts` (Lines 15-21, 50-60)
-
---
-
-## 4. REST CONTROLLERS (API Endpoints to Migrate)
-
-### 4.1 Connection Controller
-**File:** `src/modules/connection/connection.controller.ts`
-
-| HTTP Method | Endpoint | Description |
-|-------------|----------|-------------|
-| POST | `/connections` | Create a new connection |
-| PUT | `/connections/:id` | Update an existing connection |
-| DELETE | `/connections/:id` | Delete a connection |
-| GET | `/connections` | Get all connections |
-| GET | `/connections/:id` | Get connection details |
-| GET | `/connections/available/:connector_id` | Get available connections by connector |
-
-### 4.2 Connector Controller
-**File:** `src/modules/connector/connector.controller.ts`
-
-| HTTP Method | Endpoint | Description |
-|-------------|----------|-------------|
-| POST | `/connectors` | Register a new connector |
-| POST | `/connectors/uploads` | Upload multiple connector files |
-| GET | `/connectors` | List all connectors |
-| PUT | `/connectors/:id` | Update a connector |
-| DELETE | `/connectors/:id` | Delete a connector |
-
-### 4.3 Inputs Controller
-**File:** `src/modules/inputs/inputs.controller.ts`
-
-| HTTP Method | Endpoint | Description |
-|-------------|----------|-------------|
-| GET | `/inputs/available-entities/:plugin` | Get available entities for a plugin |
-| POST | `/inputs` | Create an input |
-| PATCH | `/inputs` | Update an input |
-| DELETE | `/inputs/:id` | Delete an input |
-
-### 4.4 Network Config Controller
-**File:** `src/modules/network-config/network-config.controller.ts`
-
-| HTTP Method | Endpoint | Description |
-|-------------|----------|-------------|
-| GET | `/network-configs` | Get all network configurations |
-| GET | `/network-configs/:id` | Get network config by ID |
-| POST | `/network-configs` | Create network configuration |
-| PUT | `/network-configs/:id` | Update network configuration |
-| DELETE | `/network-configs/:id` | Delete network configuration |
-
-### 4.5 Connection Test Controller
-**File:** `src/modules/connection-test/connection-test.controller.ts`
-
-| HTTP Method | Endpoint | Description |
-|-------------|----------|-------------|
-| POST | `/connection-test` | Test a connection |
-
-### 4.6 Transformations Controller
-**File:** `src/modules/transformations/transformations.controller.ts`
-
-| HTTP Method | Endpoint | Description |
-|-------------|----------|-------------|
-| POST | `/transformations` | Create transformation |
-| GET | `/transformations` | Get transformations |
-| PUT | `/transformations/:id` | Update transformation |
-| DELETE | `/transformations/:id` | Delete transformation |
-
---
-
-## 5. CONFIGURATION FILES
-
-### 5.1 Helm Chart Values (Production)
-**File:** `deploy/helm-chart/values.yaml`
-```yaml
-# Lines 32, 42
-maestro:
-  in_factory_url: in-factory.dadosfera.ai
-  tr_factory_url: in-factory.dadosfera.ai  # Transformation factory also uses in-factory
-```
-
-### 5.2 Helm Chart Values (Staging)
-**File:** `deploy/helm-chart/values-stg.yaml`
-```yaml
-# Lines 5-6
-maestro:
-  in_factory_url: in-factory.stg.dadosfera.ai
-  tr_factory_url: in-factory.stg.dadosfera.ai
-```
-
-### 5.3 Helmfiles (Production)
-**File:** `deploy/helmfiles/prd.yaml`
-```yaml
-# Lines 15-18, 39-42 (for both maestro and maestro-unimed releases)
-maestro.in_factory_url: in-factory.dadosfera.ai
-maestro.tr_factory_url: in-factory.dadosfera.ai
-```
-
-### 5.4 Deployment Template
-**File:** `deploy/helm-chart/templates/deployment.yaml`
-```yaml
-# Lines 71-72
- name: INFACTORY_URL
-  value: {{ .Values.maestro.in_factory_url }}
-```
-
-### 5.5 Environment Type Definition
-**File:** `environment.d.ts`
-```typescript
-// Line 9
-INFACTORY_URL: string;
-```
-
---
-
-## 6. PROTO PACKAGE DEPENDENCIES
-
-### 6.1 Package.json
-**File:** `package.json`
-```json
-{
-  "@dadosfera/protospack": "2.5.3",
-  "@dadosfera/protospack-v2": "3.38.0-beta.14"
-}
-```
-
-### 6.2 Proto Imports from `@dadosfera/protospack-v2` (In-Factory related)
-
-| Import Path | Used In |
-|-------------|---------|
-| `ConnectionManager` | connection/client.config.ts, connection/client.service.ts |
-| `ConnectionManager/interfaces/messages` | connection/client.service.ts, connection/dtos/connection.ts |
-| `ConnectionManager/interfaces/entities` | connection/dtos/connection.ts |
-| `ConnectorManager` | connector/client.config.ts, connector/client.service.ts |
-| `Input` | inputs/inputs-client.config.ts, inputs/inputs.service.ts |
-| `Input/interfaces/messages` | inputs/inputs.service.ts |
-| `Input/interfaces/entities` | inputs/inputs.controller.ts, inputs/inputs.service.ts |
-| `NetworkConfig` | network-config/network-config-client.config.ts, network-config/network-config.service.ts |
-| `NetworkConfig/interfaces/entities` | network-config/dto/network-config.ts |
-| `ConnectionTest` | connection-test/connection-test-client.config.ts, connection-test/connection-test.service.ts |
-| `Transformation` | transformations/transformations-client.ts, transformations/client.service.ts |
-
---
-
-## 7. MIGRATION STRATEGY OPTIONS
-
-### Option A: Move In-Factory functionality INTO Maestro
-**Pros:**
- Single service to maintain
- No network latency for these operations
- Simpler deployment
-
-**Cons:**
- Increases Maestro's responsibility/complexity
- Requires database access from Maestro
- May require significant refactoring
-
-**Files to create/migrate:**
-1. Database models for connections, connectors, inputs, network-configs, transformations
-2. Repository layer for database operations
-3. Convert gRPC services to internal services
-4. Remove all gRPC client configurations
-
-### Option B: Create REST API wrapper in In-Factory
-**Pros:**
- Minimal changes to Maestro
- Can migrate incrementally
-
-**Cons:**
- Still maintains dependency
- Additional REST→gRPC translation layer
-
-### Option C: Direct database access from Maestro
-**Pros:**
- Removes runtime dependency
- Better performance
-
-**Cons:**
- Shared database coupling
- Complex migration
-
---
-
-## 8. FILES TO MODIFY/DELETE (Summary)
-
-### High Priority - Core Integration Files
-```
-src/modules/connection/client.config.ts          → DELETE or REPLACE
-src/modules/connection/client.service.ts         → REPLACE with local implementation
-src/modules/connector/client.config.ts           → DELETE or REPLACE
-src/modules/connector/client.service.ts          → REPLACE with local implementation
-src/modules/inputs/inputs-client.config.ts       → DELETE or REPLACE
-src/modules/inputs/inputs.service.ts             → REPLACE with local implementation
-src/modules/network-config/network-config-client.config.ts → DELETE or REPLACE
-src/modules/network-config/network-config.service.ts      → REPLACE with local implementation
-src/modules/connection-test/connection-test-client.config.ts → DELETE or REPLACE
-src/modules/connection-test/connection-test.service.ts    → REPLACE with local implementation
-src/modules/transformations/transformations-client.ts     → DELETE or REPLACE
-src/modules/transformations/client.service.ts            → REPLACE with local implementation
-```
-
-### Medium Priority - Module Registration
-```
-src/modules/connection/connection.module.ts      → UPDATE imports
-src/modules/connector/connector.module.ts        → UPDATE imports
-src/modules/inputs/inputs.module.ts              → UPDATE imports
-src/modules/network-config/network-config.module.ts → UPDATE imports
-src/modules/connection-test/connection-test.module.ts → UPDATE imports
-src/modules/transformations/transformations.module.ts → UPDATE imports
-src/app.module.ts                                → UPDATE if module structure changes
-```
-
-### Low Priority - Configuration
-```
-deploy/helm-chart/values.yaml                    → REMOVE in_factory_url, tr_factory_url
-deploy/helm-chart/values-stg.yaml                → REMOVE in_factory_url, tr_factory_url
-deploy/helmfiles/prd.yaml                        → REMOVE in_factory_url references
-deploy/helm-chart/templates/deployment.yaml      → REMOVE INFACTORY_URL env var
-environment.d.ts                                 → REMOVE INFACTORY_URL type
-README.md                                        → UPDATE architecture diagram
-```
-
---
-
-## 9. DEPENDENCY COUNT BY MODULE
-
-| Module | Files | gRPC Calls | REST Endpoints |
-|--------|-------|------------|----------------|
-| Connection | 4 | 7 | 6 |
-| Connector | 3 | 6 | 5 |
-| Inputs | 3 | 4 | 4 |
-| Network Config | 3 | 5 | 5 |
-| Connection Test | 3 | 1 | 1 |
-| Transformations | 4 | 4+ | 4 |
-| **TOTAL** | **20** | **27+** | **25** |
-
---
-
-## 10. DATA MODELS (Proto Messages Used)
-
-### Connection Manager
- `CreateConnectionRequest` / `CreateConnectionResponse`
- `UpdateConnectionRequest` / `UpdateConnectionResponse`
- `DeleteConnectionRequest` / `DeleteConnectionResponse`
- `GetConnectionDetailsRequest` / `GetConnectionDetailsResponse`
- `GetAllConnectionsRequest` / `GetAllConnectionsResponse`
- `Connection` (entity)
- `ConnectionCredential` (entity)
-
-### Connector Manager
- `RegisterConnectorRequest` / `RegisterConnectorResponse`
- `UploadFileRequest` / `UploadFileResponse`
- `GetConnectorsRequest` / `GetConnectorsResponse`
- `Connector` (entity)
-
-### Input
- `CreateInputRequest` / `CreateInputResponse`
- `UpdateInputRequest` / `UpdateInputResponse`
- `DeleteInputRequest` / `DeleteInputResponse`
- `GetAvailableEntitiesRequest` / `GetAvailableEntitiesResponse`
- `Info` (entity)
-
-### Network Config
- `NetworkConfigCreateRequest` / `NetworkConfigCreateResponse`
- `NetworkConfigUpdateRequest` / `NetworkConfigUpdateResponse`
- `NetworkConfigDeleteRequest` / `NetworkConfigDeleteResponse`
- `NetworkConfigFindAllRequest` / `NetworkConfigFindAllResponse`
- `NetworkConfig` (entity)
-
-### Connection Test
- `TestConnectionRequest` / `TestConnectionResponse`
-
-### Transformation
- `CreateTransformationRequest` / `CreateTransformationResponse`
- `UpdateTransformationRequest` / `UpdateTransformationResponse`
- `DeleteTransformationRequest` / `DeleteTransformationResponse`
-
---
-
-## NEXT STEPS
-
-1. **Decide on migration strategy** (Option A, B, or C)
-2. **Prioritize modules** - Recommend starting with Connection Test (smallest), then Inputs, Network Config, Transformations, Connection, Connector (largest)
-3. **Create database schema** if moving to Option A
-4. **Implement local services** one module at a time
-5. **Update tests** for each migrated module
-6. **Update deployment configs** to remove INFACTORY_URL
-7. **Coordinate with In-Factory team** for data migration
@@ -1,320 +0,0 @@
-# In-Factory Side - Migration Requirements
-
-This document outlines what needs to be addressed in the **In-Factory** service to remove its coupling with Maestro.
-
-> **Note:** This analysis is based on the Maestro codebase. For a complete analysis, the In-Factory repository should also be reviewed.
-
---
-
-## Current Architecture (In-Factory → Maestro)
-
-Based on the Maestro codebase analysis, **In-Factory** exposes the following gRPC services that Maestro consumes:
-
-```mermaid
-graph LR;
-  Maestro -->|gRPC| InFactory;
-  subgraph InFactory Services
-    CM[ConnectionManager]
-    ConM[ConnectorManager]
-    IN[Input]
-    NC[NetworkConfig]
-    CT[ConnectionTest]
-    TR[Transformation]
-  end
-  Maestro --> CM;
-  Maestro --> ConM;
-  Maestro --> IN;
-  Maestro --> NC;
-  Maestro --> CT;
-  Maestro --> TR;
-```
-
---
-
-## gRPC Services Exposed by In-Factory
-
-### 1. ConnectionManager Service
-
-**Package:** `ConnectionManager` from `@dadosfera/protospack-v2`
-
-#### Write Services (`ConnectionManagerWriteServices`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `CreateConnection` | Create a new data connection | Maestro POST /connections |
-| `UpdateConnection` | Update an existing connection | Maestro PUT /connections/:id |
-| `DeleteConnection` | Delete a connection | Maestro DELETE /connections/:id |
-
-#### Read Services (`ConnectionManagerReadServices`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `GetConnectionDetails` | Get details of a single connection | Maestro GET /connections/:id |
-| `GetAllConnections` | List all connections for a customer | Maestro GET /connections |
-| `GetConnectorAvailableConnectionsByCustomer` | Get available connections by connector | Maestro GET /connections/available/:connector_id |
-| `ValidatePlatformConnections` | Validate connections against platform | Maestro internal |
-
---
-
-### 2. ConnectorManager Service
-
-**Package:** `ConnectorManager` from `@dadosfera/protospack-v2`
-
-#### Write Services (`ConnectorManagerWriteServices`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `RegisterConnector` | Register a new connector | Maestro POST /connectors |
-| `UploadFile` | Upload connector files | Maestro POST /connectors/uploads |
-| `RegisterMultipleConnectorsWithoutImage` | Bulk register connectors | Maestro internal |
-| `UpdateConnectorByID` | Update a connector | Maestro PUT /connectors/:id |
-| `DeleteConnectorById` | Delete a connector | Maestro DELETE /connectors/:id |
-
-#### Read Services (`ConnectorManagerReadServices`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `GetConnectors` | List all connectors | Maestro GET /connectors |
-
---
-
-### 3. Input Service
-
-**Package:** `Input` from `@dadosfera/protospack-v2`
-
-#### Write Services (`InputWriteService`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `CreateInput` | Create a new input configuration | Maestro POST /inputs |
-| `UpdateInput` | Update input configuration | Maestro PATCH /inputs |
-| `DeleteInput` | Delete an input | Maestro DELETE /inputs/:id |
-
-#### Read Services (`InputReadService`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `GetAvailableEntities` | Get available entities for a plugin | Maestro GET /inputs/available-entities/:plugin |
-
---
-
-### 4. NetworkConfig Service
-
-**Package:** `NetworkConfig` from `@dadosfera/protospack-v2`
-
-#### Write Services (`NetworkConfigWriteService`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `NetworkConfigCreate` | Create network configuration | Maestro POST /network-configs |
-| `NetworkConfigUpdate` | Update network configuration | Maestro PUT /network-configs/:id |
-| `NetworkConfigDelete` | Delete network configuration | Maestro DELETE /network-configs/:id |
-
-#### Read Services (`NetworkConfigReadService`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `NetworkConfigFindAll` | List all network configs | Maestro GET /network-configs |
-| `NetworkConfigFindOneById` | Get network config by ID | Maestro GET /network-configs/:id |
-
---
-
-### 5. ConnectionTest Service
-
-**Package:** `ConnectionTest` from `@dadosfera/protospack-v2`
-
-#### Read Services (`ConnectionTestReadService`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `TestConnection` | Test a connection's connectivity | Maestro POST /connection-test |
-
---
-
-### 6. Transformation Service
-
-**Package:** `Transformation` from `@dadosfera/protospack-v2`
-
-#### Write Services (`TransformationWriteService`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| `CreateTransformation` | Create a transformation | Maestro POST /transformations |
-| `UpdateTransformation` | Update a transformation | Maestro PUT /transformations/:id |
-| `DeleteTransformation` | Delete a transformation | Maestro DELETE /transformations/:id |
-
-#### Read Services (`TransformationReadService`)
-| gRPC Method | Description | Called By |
-|-------------|-------------|-----------|
-| Various read operations | Get transformation details | Maestro GET /transformations |
-
---
-
-## Proto Package Ownership
-
-The proto definitions are managed in `@dadosfera/protospack-v2`:
-
-```
-@dadosfera/protospack-v2/
-├── dist/lib/
-│   ├── ConnectionManager/
-│   │   ├── interfaces/messages.ts
-│   │   └── interfaces/entities.ts
-│   ├── ConnectorManager/
-│   │   ├── interfaces/messages.ts
-│   │   └── interfaces/entities.ts
-│   ├── Input/
-│   │   ├── interfaces/messages.ts
-│   │   └── interfaces/entities.ts
-│   ├── NetworkConfig/
-│   │   ├── interfaces/messages.ts
-│   │   └── interfaces/entities.ts
-│   ├── ConnectionTest/
-│   │   ├── interfaces/messages.ts
-│   │   └── interfaces/entities.ts
-│   └── Transformation/
-│       ├── interfaces/messages.ts
-│       └── interfaces/entities.ts
-```
-
---
-
-## In-Factory Migration Options
-
-### Option 1: Expose REST API (Keep In-Factory, Add REST Layer)
-
-**Changes Required in In-Factory:**
-1. Add REST controllers for all services
-2. Implement HTTP endpoints mirroring gRPC methods
-3. Update deployment to expose HTTP port
-4. Create OpenAPI documentation
-
-**Pros:**
- Minimal architectural changes
- Can run both gRPC and REST in parallel during migration
- Maestro can switch to REST calls gradually
-
-**Cons:**
- Still maintains service dependency
- Adds another communication layer
-
---
-
-### Option 2: Move Logic to Maestro (Deprecate In-Factory for these features)
-
-**Changes Required in In-Factory:**
-1. Export database schema/migrations
-2. Document all business logic
-3. Provide data migration scripts
-4. Deprecate gRPC endpoints after migration
-
-**Changes Required in Maestro:**
-1. Create database models
-2. Implement repositories
-3. Create service layer with same business logic
-4. Run data migration
-
-**Pros:**
- Removes runtime dependency completely
- Simplifies architecture
- One less service to maintain
-
-**Cons:**
- Significant development effort
- Risk of business logic divergence during migration
- Database sharing concerns
-
---
-
-### Option 3: Merge Services (Combine In-Factory into a larger service)
-
-**Changes Required:**
-1. Create new combined service
-2. Migrate both In-Factory and relevant Maestro code
-3. Update all clients
-
-**Pros:**
- Clean architectural redesign
- Opportunity to optimize
-
-**Cons:**
- Largest effort
- Risk of disruption
-
---
-
-## Data Migration Considerations
-
-### Entities Managed by In-Factory
-
-Based on proto definitions, In-Factory manages:
-
-1. **Connections**
-   - Connection credentials
-   - Connection metadata
-   - Customer associations
-
-2. **Connectors**
-   - Connector definitions
-   - Connector images/files
-   - Plugin configurations
-
-3. **Inputs**
-   - Input configurations
-   - Entity mappings
-
-4. **Network Configs**
-   - Network configuration settings
-   - Security settings
-
-5. **Transformations**
-   - Transformation definitions
-   - Transformation scripts
-
-### Migration Steps
-1. Export database schema from In-Factory
-2. Create equivalent schema in target database
-3. Write data migration scripts
-4. Validate data integrity
-5. Switch traffic
-6. Decommission old service
-
---
-
-## Recommended Investigation for In-Factory Team
-
-1. **Check for Maestro dependencies in In-Factory**
-   - Does In-Factory call any Maestro APIs?
-   - Are there any shared databases?
-   - Any shared message queues?
-
-2. **Document database schema**
-   - All tables related to connections, connectors, inputs, network-configs, transformations
-   - Foreign key relationships
-   - Indexes and constraints
-
-3. **List all consumers**
-   - Besides Maestro, who else calls In-Factory?
-   - Are there other internal services?
-   - Any external integrations?
-
-4. **Business logic documentation**
-   - Validation rules
-   - Business constraints
-   - Side effects (events, notifications, etc.)
-
---
-
-## Timeline Considerations
-
-| Phase | Description | Dependencies |
-|-------|-------------|--------------|
-| Phase 1 | Analysis & Planning | Both teams available |
-| Phase 2 | Schema/API Design | Proto definitions finalized |
-| Phase 3 | Implementation | Development resources |
-| Phase 4 | Data Migration | Database access, downtime window |
-| Phase 5 | Testing | QA resources, test environments |
-| Phase 6 | Cutover | Deployment coordination |
-| Phase 7 | Decommission | Monitoring, rollback plan |
-
---
-
-## Questions for In-Factory Team
-
-1. What database does In-Factory use? (PostgreSQL, MongoDB, etc.)
-2. Are there any async operations? (message queues, event sourcing)
-3. What is the current data volume for each entity type?
-4. Are there any scheduled jobs or background processes?
-5. What monitoring/alerting is in place?
-6. Are there any data retention policies?
-7. What is the backup/recovery strategy?
@@ -1,486 +0,0 @@
-# Maestro ↔ PI-Factory Migration Map
-
-This document maps all integration points between Maestro and PI-Factory that need to be addressed to remove the dependency.
-
-## Architecture Overview
-
-```mermaid
-graph TD;
-  Frontend<-->Maestro;
-  Maestro<-->DUC;
-  Maestro<-->pi-factory;
-  Maestro<-->in-factory;
-```
-
-PI-Factory (`PIFACTORY_URL`) is responsible for:
- **Pipeline Management** - Create, read, update, delete pipelines
- **Catalog Services** - Data asset management, metadata, previews
- **Platform Interfaces** - Dataset cataloging operations
-
---
-
-## Summary Table
-
-| Category | Count | Impact Level |
-|----------|-------|--------------|
-| gRPC Client Configurations | 3 | HIGH |
-| NestJS Modules | 3 | HIGH |
-| REST Controllers/Endpoints | 3 (~50 endpoints) | HIGH |
-| Service Classes | 4 | HIGH |
-| Configuration Files | 4 | MEDIUM |
-| Proto Package Dependencies | 2 | HIGH |
-| Environment Variables | 1 | LOW |
-
---
-
-## 1. gRPC CLIENT CONFIGURATIONS (Files to Migrate)
-
-These files configure gRPC connections to PI-Factory services:
-
-### 1.1 Catalog Client (`PIFACTORY_URL`)
-**File:** `src/modules/catalog/catalog-client.ts`
-```typescript
-// Lines 11-12, 19
-process.env.PIFACTORY_URL.startsWith('pi-factory:')
-process.env.PIFACTORY_URL.includes('0.0.0.0')
-url: process.env.PIFACTORY_URL
-```
-**Proto Services Used:**
- `Catalog.ProtoPackages.ReadPackage`
- `Catalog.ProtoPackages.WritePackage`
- `PlatformInterfaces.ProtoPackages.WritePackage`
-
-### 1.2 Pipelines V2 Client (`PIFACTORY_URL`)
-**File:** `src/modules/pipelinesV2/pipelines-client.ts`
-```typescript
-// Lines 13-14, 21
-url: process.env.PIFACTORY_URL
-```
-**Proto Services Used:**
- `PipelineV2.ProtoPackages.ReadPackage`
- `PipelineV2.ProtoPackages.WritePackage`
-
-### 1.3 Pipelines Client (Legacy) (`PIFACTORY_URL`)
-**File:** `src/modules/pipelines/pipelines-client.ts`
-```typescript
-// Lines 10-11, 18
-url: process.env.PIFACTORY_URL
-```
-**Proto Services Used:**
- `PipelinePackages` from `@dadosfera/protospack`
-
---
-
-## 2. SERVICE CLASSES (Business Logic to Migrate)
-
-### 2.1 Catalog Service
-**File:** `src/modules/catalog/catalog.service.ts`
-
-**gRPC Services Initialized:**
- `CatalogReadServices` (from `Catalog.ReadService`)
- `CatalogWriteServices` (from `Catalog.WriteService`)
- `PlatformInterfacesWriteServices` (from `PlatformInterfaces.WriteService`)
-
-**gRPC Methods Called:**
-
-| Method | Service | Description |
-|--------|---------|-------------|
-| `GetAllDataAssets()` | CatalogReadServices | Search/list data assets |
-| `GetOneDataAsset()` | CatalogReadServices | Get single data asset by ID |
-| `GetOneDataAssetByPipelineAndObject()` | CatalogReadServices | Get asset by pipeline/object |
-| `GetDatasetDoc()` | CatalogReadServices | Get dataset documentation |
-| `GetDatasetPreview()` | CatalogReadServices | Get data preview |
-| `GetDatasetColumnsMetadata()` | CatalogReadServices | Get column metadata |
-| `GetCustomerTags()` | CatalogReadServices | Get all tags for customer |
-| `GetDatasetCatalogTask()` | CatalogReadServices | Get catalog task status |
-| `GetRlsRules()` | CatalogReadServices | Get RLS rules |
-| `GetOneRlsRule()` | CatalogReadServices | Get single RLS rule |
-| `GetNimbusDashboards()` | CatalogReadServices | Get Nimbus dashboards |
-| `CreateDataAsset()` | CatalogWriteServices | Create new data asset |
-| `UpdateDataAsset()` | CatalogWriteServices | Update existing data asset |
-| `DeleteDataAsset()` | CatalogWriteServices | Delete data asset |
-| `ManagePermission()` | CatalogWriteServices | Manage asset permissions |
-| `RevokePermission()` | CatalogWriteServices | Revoke asset permissions |
-| `MakeAComment()` | CatalogWriteServices | Add comment to asset |
-| `UpdateAComment()` | CatalogWriteServices | Update/delete comment |
-| `TriggerDatasetCataloging()` | CatalogWriteServices | Trigger catalog process |
-| `AddRlsRule()` | CatalogWriteServices | Add RLS rule |
-| `RemoveRlsRule()` | CatalogWriteServices | Remove RLS rule |
-| `RemoveRlsRulesByRlsId()` | CatalogWriteServices | Batch remove by RLS ID |
-| `RemoveRlsRulesByDashboardId()` | CatalogWriteServices | Batch remove by dashboard |
-| `GetPiiReporter()` | CatalogWriteServices | Get PII report data |
-| `CatalogDataAssets()` | PlatformInterfacesWriteServices | Catalog datasets |
-
-**Additional HTTP Calls to Nimbus:**
- `POST ${nimbusUrl}/api/catalog/data-docs/` - Create data docs
- `POST ${nimbusUrl}/api/catalog/table-metadata/` - Create table metadata
- `POST ${nimbusUrl}/api/catalog/column-metadata/` - Create column metadata
- `POST ${nimbusUrl}/api/catalog/data-preview/` - Create data preview
-
-### 2.2 Pipelines V2 Service
-**File:** `src/modules/pipelinesV2/pipelines.service.ts`
-
-**gRPC Services Initialized:**
- `PipelineV2ReadService` (from `PipelineV2.ReadService`)
- `PipelineV2WriteService` (from `PipelineV2.WriteService`)
-
-**gRPC Methods Called:**
-
-| Method | Service | Description |
-|--------|---------|-------------|
-| `PipelineV2Create()` | PipelineV2WriteService | Create new pipeline |
-| `PipelineV2Update()` | PipelineV2WriteService | Update pipeline |
-| `PipelineV2Remove()` | PipelineV2WriteService | Delete pipeline |
-| `PipelineV2UploadFile()` | PipelineV2WriteService | Initialize file upload |
-| `PipelineV2CompleteUploadFile()` | PipelineV2WriteService | Complete file upload |
-| `PipelineV2FindAll()` | PipelineV2ReadService | List all pipelines |
-| `PipelineV2FindOne()` | PipelineV2ReadService | Get single pipeline |
-| `PipelineV2FindObjects()` | PipelineV2ReadService | Get pipeline objects |
-| `PipelineV2DownloadLogs()` | PipelineV2ReadService | Download pipeline logs |
-| `PipelineV2GetDashboardUrl()` | PipelineV2ReadService | Get monitoring dashboard URL |
-
-### 2.3 Pipelines Service (Legacy)
-**File:** `src/modules/pipelines/pipelines.service.ts`
-
-**Uses:** `PipelinesClientService`
-
-**Methods:**
- `getPipelineStatus()` - Get pipeline execution status
- `runPipeline()` - Trigger pipeline execution
-
-### 2.4 Pipelines Client Service (Legacy)
-**File:** `src/modules/pipelines/client.service.ts`
-
-**gRPC Methods Called:**
-| Method | Service | Description |
-|--------|---------|-------------|
-| `getPipelineStatus()` | PipelineService | Get pipeline status |
-| `triggerPipeline()` | PipelineService | Trigger pipeline run |
-
---
-
-## 3. NESTJS MODULES (Module Registration)
-
-| Module | File | Client Configuration | Exports |
-|--------|------|---------------------|---------|
-| CatalogModule | `src/modules/catalog/catalog.module.ts` | CatalogClientConfiguration | CatalogService |
-| PipelinesV2Module | `src/modules/pipelinesV2/pipelines.module.ts` | PipelinesClientConfiguration | PipelinesService |
-| PipelinesModule | `src/modules/pipelines/pipelines.module.ts` | PipelinesClientConfiguration | PipelinesService, PipelinesClientService |
-
-**App Module Registration:** `src/app.module.ts` (Lines 20, 23, 25, 53-54, 59)
-
---
-
-## 4. REST CONTROLLERS (API Endpoints to Migrate)
-
-### 4.1 Catalog Controller
-**File:** `src/modules/catalog/catalog.controller.ts`
-**Base Path:** `/catalog`
-
-| HTTP Method | Endpoint | Description |
-|-------------|----------|-------------|
-| GET | `/catalog` | Search data assets |
-| GET | `/catalog/download` | Download assets as CSV |
-| GET | `/catalog/data-asset` | Get asset by pipeline/object |
-| GET | `/catalog/data-asset/:id` | Get single data asset |
-| GET | `/catalog/data-asset/rls/:id` | Get data asset RLS info |
-| GET | `/catalog/data-asset/:id/columns-metadata` | Get column metadata |
-| GET | `/catalog/data-asset/:id/preview` | Get data preview |
-| GET | `/catalog/data-asset/:id/docs` | Get documentation |
-| GET | `/catalog/tags` | Get all tags |
-| PUT | `/catalog/data-asset/:id` | Update data asset |
-| PUT | `/catalog/data-asset/:id/manage-permissions` | Manage permissions |
-| PUT | `/catalog/data-asset/:id/revoke-permissions` | Revoke permissions |
-| POST | `/catalog` | Create data asset |
-| POST | `/catalog/data-asset/:id/docs` | Create documentation |
-| POST | `/catalog/data-asset/:id/comment` | Add comment |
-| POST | `/catalog/dataset-catalog-task` | Trigger catalog task |
-| POST | `/catalog/rls-rule` | Add RLS rule |
-| POST | `/catalog/register-dataset` | Register dataset with metadata |
-| DELETE | `/catalog/data-asset/:id` | Delete data asset |
-| DELETE | `/catalog/data-asset/:id/comment` | Delete comment |
-| DELETE | `/catalog/rls-rule/:id` | Remove RLS rule |
-| DELETE | `/catalog/rls-rule` | Batch remove RLS rules |
-| GET | `/catalog/dataset-catalog-task/:session` | Get catalog task status |
-| GET | `/catalog/rls-rule/:id` | Get single RLS rule |
-| GET | `/catalog/rls-rule` | Get RLS rules |
-| GET | `/catalog/nimbus-dashboards` | Get Nimbus dashboards |
-| GET | `/catalog/pii-reporter` | Get PII report |
-
-**Total: 27 endpoints**
-
-### 4.2 Pipelines V2 Controller
-**File:** `src/modules/pipelinesV2/pipelines.controller.ts`
-**Base Path:** `/pipelinesV2`
-
-| HTTP Method | Endpoint | Description |
-|-------------|----------|-------------|
-| GET | `/pipelinesV2/monitoring-dashboard` | Get monitoring dashboard URL |
-| GET | `/pipelinesV2` | List all pipelines |
-| GET | `/pipelinesV2/download-logs` | Download pipeline logs |
-| GET | `/pipelinesV2/:id` | Get single pipeline |
-| GET | `/pipelinesV2/:id/config` | Get pipeline properties |
-| GET | `/pipelinesV2/:id/objects` | Get pipeline objects |
-| GET | `/pipelinesV2/:id/status` | Get pipeline status (legacy) |
-| POST | `/pipelinesV2` | Create pipeline |
-| POST | `/pipelinesV2/init-upload` | Initialize file upload |
-| POST | `/pipelinesV2/complete-upload` | Complete file upload |
-| POST | `/pipelinesV2/file` | Upload file pipeline |
-| POST | `/pipelinesV2/start/:id` | Start pipeline |
-| PATCH | `/pipelinesV2/:id` | Update pipeline |
-| PUT | `/pipelinesV2/:id` | Update pipeline (deprecated) |
-| DELETE | `/pipelinesV2/:id` | Delete pipeline |
-
-**Total: 15 endpoints**
-
-### 4.3 Pipelines Controller (Legacy)
-**File:** `src/modules/pipelines/pipelines.controller.ts`
-**Base Path:** `/pipelines`
-
-| HTTP Method | Endpoint | Description |
-|-------------|----------|-------------|
-| POST | `/pipelines/start/:id` | Start pipeline (deprecated) |
-| GET | `/pipelines/:id/status` | Get pipeline status (deprecated) |
-
-**Total: 2 endpoints (deprecated)**
-
---
-
-## 5. CONFIGURATION FILES
-
-### 5.1 Helm Chart Values (Production)
-**File:** `deploy/helm-chart/values.yaml`
-```yaml
-# Line 40
-maestro:
-  pi_factory_url: pi-factory.dadosfera.ai
-```
-
-### 5.2 Helm Chart Values (Staging)
-**File:** `deploy/helm-chart/values-stg.yaml`
-```yaml
-# Line 4
-maestro:
-  pi_factory_url: pi-factory.stg.dadosfera.ai
-```
-
-### 5.3 Helmfiles (Production)
-**File:** `deploy/helmfiles/prd.yaml`
-```yaml
-# Lines 14, 38
-maestro.pi_factory_url: pi-factory.dadosfera.ai
-```
-
-### 5.4 Deployment Template
-**File:** `deploy/helm-chart/templates/deployment.yaml`
-```yaml
-# Line 85
- name: PIFACTORY_URL
-  value: {{ .Values.maestro.pi_factory_url }}
-```
-
-### 5.5 Environment Type Definition
-**File:** `environment.d.ts`
-```typescript
-// Line 10
-PIFACTORY_URL: string;
-```
-
---
-
-## 6. PROTO PACKAGE DEPENDENCIES
-
-### 6.1 Package.json
-**File:** `package.json`
-```json
-{
-  "@dadosfera/protospack": "2.5.3",      // Legacy pipelines
-  "@dadosfera/protospack-v2": "3.38.0-beta.14"  // PipelineV2, Catalog, PlatformInterfaces
-}
-```
-
-### 6.2 Proto Imports from `@dadosfera/protospack-v2` (PI-Factory related)
-
-| Import Path | Used In |
-|-------------|---------|
-| `Catalog` | catalog/catalog-client.ts, catalog/catalog.service.ts |
-| `Catalog/interfaces/messages` | catalog/catalog.service.ts, catalog/catalog.controller.ts, catalog/dtos |
-| `PlatformInterfaces` | catalog/catalog-client.ts, catalog/catalog.service.ts |
-| `PipelineV2` | pipelinesV2/pipelines-client.ts, pipelinesV2/pipelines.service.ts |
-| `PipelineV2/interfaces/messages` | pipelinesV2/pipelines.service.ts, pipelinesV2/pipelines.controller.ts |
-
-### 6.3 Proto Imports from `@dadosfera/protospack` (Legacy)
-
-| Import Path | Used In |
-|-------------|---------|
-| `PipelinePackages` | pipelines/pipelines-client.ts |
-| `PipelineProtoFilePath` | pipelines/pipelines-client.ts |
-| `PipelineServicesNames` | pipelines/client.service.ts |
-| `PipelinesServiceInterface` | pipelines/client.service.ts |
-
---
-
-## 7. FILES TO MODIFY/DELETE (Summary)
-
-### High Priority - Core Integration Files
-```
-src/modules/catalog/catalog-client.ts              → DELETE or REPLACE
-src/modules/catalog/catalog.service.ts             → REPLACE with local implementation
-src/modules/pipelinesV2/pipelines-client.ts        → DELETE or REPLACE
-src/modules/pipelinesV2/pipelines.service.ts       → REPLACE with local implementation
-src/modules/pipelines/pipelines-client.ts          → DELETE or REPLACE
-src/modules/pipelines/client.service.ts            → REPLACE with local implementation
-src/modules/pipelines/pipelines.service.ts         → REPLACE with local implementation
-```
-
-### Medium Priority - Module Registration
-```
-src/modules/catalog/catalog.module.ts              → UPDATE imports
-src/modules/pipelinesV2/pipelines.module.ts        → UPDATE imports
-src/modules/pipelines/pipelines.module.ts          → UPDATE imports
-src/app.module.ts                                  → UPDATE if module structure changes
-```
-
-### Low Priority - Configuration
-```
-deploy/helm-chart/values.yaml                      → REMOVE pi_factory_url
-deploy/helm-chart/values-stg.yaml                  → REMOVE pi_factory_url
-deploy/helmfiles/prd.yaml                          → REMOVE pi_factory_url references
-deploy/helm-chart/templates/deployment.yaml        → REMOVE PIFACTORY_URL env var
-environment.d.ts                                   → REMOVE PIFACTORY_URL type
-README.md                                          → UPDATE architecture diagram
-```
-
---
-
-## 8. DEPENDENCY COUNT BY MODULE
-
-| Module | Files | gRPC Calls | REST Endpoints |
-|--------|-------|------------|----------------|
-| Catalog | 3 | 24+ | 27 |
-| PipelinesV2 | 3 | 10 | 15 |
-| Pipelines (Legacy) | 3 | 2 | 2 |
-| **TOTAL** | **9** | **36+** | **44** |
-
---
-
-## 9. COMPARISON: PI-Factory vs In-Factory
-
-| Aspect | PI-Factory | In-Factory |
-|--------|------------|------------|
-| Environment Variable | `PIFACTORY_URL` | `INFACTORY_URL` |
-| Modules | 3 | 6 |
-| gRPC Calls | 36+ | 27+ |
-| REST Endpoints | 44 | 25 |
-| Complexity | HIGH | MEDIUM-HIGH |
-| Domain | Pipelines, Catalog | Connections, Connectors, Inputs |
-
---
-
-## 10. DATA MODELS (Proto Messages Used)
-
-### Catalog Messages
- `CreateDataAssetRequest` / `CreateDataAssetResponse`
- `GetAllDataAssetsRequest` / `GetAllDataAssetsResponse`
- `GetOneDataAssetRequest` / Response
- `UpdateDataAssetRequest` / Response
- `DeleteDataAssetRequest` / Response
- `ManagePermissionRequest` / Response
- `RevokePermissionRequest` / Response
- `MakeACommentRequest` / Response
- `UpdateACommentRequest` / Response
- `TriggerDatasetCatalogingRequest` / Response
- `GetDatasetCatalogTaskRequest` / Response
- `AddRlsRuleRequest` / Response
- `RemoveRlsRuleRequest` / Response
- `GetRlsRulesRequest` / Response
- `GetNimbusDashboardsRequest` / Response
- `PiiMetadata`
- `RegisterDatasetWithMetatadaRequest`
-
-### PipelineV2 Messages
- `PipelineV2CreateRequest` / `PipelineV2CreateResponse`
- `PipelineV2FindAllRequest` / `PipelineV2FindAllResponse`
- `PipelineV2FindOneRequest` / `PipelineV2FindOneResponse`
- `PipelineV2UpdateRequest` / `PipelineV2UpdateResponse`
- `PipelineV2RemoveRequest` / Response
- `PipelineV2UploadFileRequest` / Response
- `PipelineV2CompleteUploadFileRequest` / Response
- `PipelineV2FindObjectsRequest` / Response
- `PipelineV2DownloadLogsRequest` / Response
- `PipelineV2GetDashboardUrlRequest` / Response
-
-### Platform Interfaces Messages
- `CatalogDataAssetsRequest` / Response
-
---
-
-## 11. MIGRATION STRATEGY OPTIONS
-
-### Option A: Move PI-Factory functionality INTO Maestro
-**Pros:**
- Single service to maintain
- No network latency for these operations
- Simpler deployment
-
-**Cons:**
- Significantly increases Maestro's responsibility
- Requires database access from Maestro
- Large refactoring effort (44 endpoints)
-
-### Option B: Create REST API wrapper in PI-Factory
-**Pros:**
- Minimal changes to Maestro
- Can migrate incrementally
-
-**Cons:**
- Still maintains dependency
- Additional REST→gRPC translation layer
-
-### Option C: Direct database access from Maestro
-**Pros:**
- Removes runtime dependency
- Better performance
-
-**Cons:**
- Shared database coupling
- Complex migration
-
---
-
-## 12. RECOMMENDED MIGRATION ORDER
-
-Given the complexity, we recommend migrating in this order:
-
-1. **Legacy Pipelines** (2 endpoints, deprecated) - Lowest risk
-2. **PipelinesV2** (15 endpoints) - Core pipeline functionality
-3. **Catalog** (27 endpoints) - Most complex, migrate last
-
-### Phase 1: Legacy Pipelines (Deprecated)
- Remove `/pipelines/start/:id`
- Remove `/pipelines/:id/status`
- Update all clients to use `/pipelinesV2/*` endpoints
-
-### Phase 2: PipelinesV2
- Migrate pipeline CRUD operations
- Migrate file upload functionality
- Migrate monitoring dashboard
-
-### Phase 3: Catalog
- Migrate data asset CRUD
- Migrate permissions management
- Migrate RLS rules
- Migrate dataset registration
- Migrate PII reporting
-
---
-
-## NEXT STEPS
-
-1. **Decide on migration strategy** (Option A, B, or C)
-2. **Deprecate legacy pipelines module** first
-3. **Create database schema** if moving to Option A
-4. **Implement local services** one module at a time
-5. **Update tests** for each migrated module
-6. **Update deployment configs** to remove PIFACTORY_URL
-7. **Coordinate with PI-Factory team** for data migration
@@ -3,6 +3,7 @@
 </p>


+
 # Maestro

 Maestro é a API principal da Dadosfera. É responsável pela comunicação do Frontend com nossos microsserviços.
@@ -104,6 +104,8 @@ spec:
              value: {{ .Values.maestro.redis_host }}
            - name: REDIS_PORT
              value: "{{ .Values.maestro.redis_port }}"
+            - name: REDIS_TLS
+              value: "{{ .Values.maestro.redis_tls }}"
            - name: JWT_PRIVATE_KEY
              valueFrom:
                secretKeyRef:
@@ -48,6 +48,7 @@ maestro:
  redis_host: "aaapzppmlyamkocqwstpo7zvopczyyiyuy6xzm2g6c5k4mq3a66be4a-0.redis.sa-saopaulo-1.oci.oraclecloud.com"
  redis_port: "6379"
  redis_database: "0"
+  redis_tls: "true"
  cookie_secret: "13cc5e136d3074bcc05bec8697092ec1f5f376bf"
 autoscaling:
  enabled: false
@@ -4471,6 +4471,14 @@
              "schema": {
                "type": "string"
              }
+            },
+            {
+              "name": "asset_type",
+              "required": true,
+              "in": "query",
+              "schema": {
+                "type": "string"
+              }
            }
          ],
          "responses": {
@@ -16,6 +16,7 @@ declare global {
      OPEN_CUSTOMER_ID: string;
      DEDICATED_PROXY: string;
      COOKIE_SECRET: string;
+      REDIS_TLS?: string;
    }
  }
 }
@@ -12,7 +12,7 @@
        "@aws-sdk/client-secrets-manager": "^3.414.0",
        "@dadosfera/dadosfera-logs": "^1.0.0-beta.4",
        "@dadosfera/protospack": "2.5.3",
-        "@dadosfera/protospack-v2": "3.38.0-beta.14",
+        "@dadosfera/protospack-v2": "3.38.0-beta.16",
        "@grpc/grpc-js": "^1.9.3",
        "@grpc/proto-loader": "^0.7.9",
        "@nestjs/cli": "^9.5.0",
@@ -850,7 +850,6 @@
      "integrity": "sha512-vMqyb7XCDMPvJFFOaT9kxtiRh42GwlZEg1/uIgtZshS5a/8OaduUfCi7kynKgc3Tw/6Uo2D+db9qBttghhmxwQ==",
      "dev": true,
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "@ampproject/remapping": "^2.2.0",
        "@babel/code-frame": "^7.26.2",
@@ -1409,10 +1408,9 @@
      }
    },
    "node_modules/@dadosfera/protospack-v2": {
-      "version": "3.38.0-beta.14",
-      "resolved": "https://dadosfera-611330257153.d.codeartifact.us-east-1.amazonaws.com/npm/dadosfera-npm/@dadosfera/protospack-v2/-/protospack-v2-3.38.0-beta.14.tgz",
-      "integrity": "sha512-BiE1fUIHuam3cJjAGIknsRNIlf1Z0JHJOV/VZ2pyAp5mIkGOSoNFBAMXJZb+VMTnd2xsp+vPxNnWVu7OJ/CvMQ==",
-      "license": "ISC",
+      "version": "3.38.0-beta.16",
+      "resolved": "https://dadosfera-611330257153.d.codeartifact.us-east-1.amazonaws.com/npm/dadosfera-npm/@dadosfera/protospack-v2/-/protospack-v2-3.38.0-beta.16.tgz",
+      "integrity": "sha512-ijURcmETXdgVgXhIPxapK7w0z6begXm4WDZ6EJtUGg+oYlJd9QOxbwaD7akRzW8XTdccmIo0Vov065KB812J0A==",
      "dependencies": {
        "@grpc/grpc-js": "^1.9.3",
        "rxjs": "^7.5.5"
@@ -2261,7 +2259,6 @@
      "resolved": "https://registry.npmjs.org/@nestjs/common/-/common-9.4.3.tgz",
      "integrity": "sha512-Gd6D4IaYj01o14Bwv81ukidn4w3bPHCblMUq+SmUmWLyosK+XQmInCS09SbDDZyL8jy86PngtBLTdhJ2bXSUig==",
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "iterare": "1.2.1",
        "tslib": "2.5.3",
@@ -2340,7 +2337,6 @@
      "integrity": "sha512-Qi63+wi55Jh4sDyaj5Hhx2jOpKqT386aeo+VOKsxnd+Ql9VvkO/FjmuwBGUyzkJt29ENYc+P0Sx/k5LtstNpPQ==",
      "hasInstallScript": true,
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "@nuxtjs/opencollective": "0.3.2",
        "fast-safe-stringify": "2.1.1",
@@ -2478,7 +2474,6 @@
      "resolved": "https://registry.npmjs.org/@nestjs/platform-express/-/platform-express-9.4.3.tgz",
      "integrity": "sha512-FpdczWoRSC0zz2dNL9u2AQLXKXRVtq4HgHklAhbL59X0uy+mcxhlSThG7DHzDMkoSnuuHY8ojDVf7mDxk+GtCw==",
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "body-parser": "1.20.2",
        "cors": "2.8.5",
@@ -2842,7 +2837,6 @@
      "resolved": "https://registry.npmjs.org/@opentelemetry/api/-/api-1.9.0.tgz",
      "integrity": "sha512-3giAOQvZiH5F9bMlMiv8+GSPMeqg0dbaeo58/0SlA9sxSqZhnUtxzX9/2FzyhS9sWQf5S0GJE0AKBrFqjpeYcg==",
      "license": "Apache-2.0",
-      "peer": true,
      "engines": {
        "node": ">=8.0.0"
      }
@@ -3002,7 +2996,6 @@
      "resolved": "https://registry.npmjs.org/@redis/client/-/client-1.6.1.tgz",
      "integrity": "sha512-/KCsg3xSlR+nCK8/8ZYSknYxvXHwubJrU82F3Lm1Fp6789VQ0/3RJKfsmRXjqfaTA++23CvC3hqmqe/2GEt6Kw==",
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "cluster-key-slot": "1.1.2",
        "generic-pool": "3.9.0",
@@ -3799,7 +3792,6 @@
      "integrity": "sha512-ejlPM315qwLpaQlQDTjPdsUFSc6ZsP4AN6AlWnogPjQ7CVi7PYF3YVz+CY3jE2pwYf7E/7HlDAN0rV2GxTG0HQ==",
      "dev": true,
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "@types/body-parser": "*",
        "@types/express-serve-static-core": "^4.17.33",
@@ -3880,7 +3872,6 @@
      "integrity": "sha512-4dRxkS/AFX0c5XW6IPMNOydLn2tEhNhJV7DnYK+0bjoJZ+QTmfucBlihX7aoEsh/ocYtkLC73UbnBXBXIxsULA==",
      "dev": true,
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "jest-diff": "^27.0.0",
        "pretty-format": "^27.0.0"
@@ -3944,8 +3935,7 @@
      "version": "16.18.126",
      "resolved": "https://registry.npmjs.org/@types/node/-/node-16.18.126.tgz",
      "integrity": "sha512-OTcgaiwfGFBKacvfwuHzzn1KLxH/er8mluiy8/uM3sGXHaRe73RrSIj01jow9t4kJEW633Ov+cOexXeiApTyAw==",
-      "license": "MIT",
-      "peer": true
+      "license": "MIT"
    },
    "node_modules/@types/oauth": {
      "version": "0.9.6",
@@ -4175,7 +4165,6 @@
      "integrity": "sha512-VlJEV0fOQ7BExOsHYAGrgbEiZoi8D+Bl2+f6V2RrXerRSylnp+ZBHmPvaIa8cz0Ajx7WO7Z5RqfgYg7ED1nRhA==",
      "dev": true,
      "license": "BSD-2-Clause",
-      "peer": true,
      "dependencies": {
        "@typescript-eslint/scope-manager": "5.62.0",
        "@typescript-eslint/types": "5.62.0",
@@ -4522,7 +4511,6 @@
      "resolved": "https://registry.npmjs.org/acorn/-/acorn-8.14.1.tgz",
      "integrity": "sha512-OvQ/2pUDKmgfCg++xsTX1wGxfTaszcHVcTctW4UJB4hibJx2HXxxO5UmVgyjMa+ZDsiaf5wWLXYpRWMmBI0QHg==",
      "license": "MIT",
-      "peer": true,
      "bin": {
        "acorn": "bin/acorn"
      },
@@ -4619,7 +4607,6 @@
      "resolved": "https://registry.npmjs.org/ajv/-/ajv-8.12.0.tgz",
      "integrity": "sha512-sRu1kpcO9yLtYxBKvqfTeh9KzZEwO3STyX1HT+4CaDzC6HpTGYhIhPIzj9XuKU7KYDwnaeh5hcOwjy1QuJzBPA==",
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "fast-deep-equal": "^3.1.1",
        "json-schema-traverse": "^1.0.0",
@@ -5248,7 +5235,6 @@
        }
      ],
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "caniuse-lite": "^1.0.30001688",
        "electron-to-chromium": "^1.5.73",
@@ -5355,7 +5341,6 @@
      "resolved": "https://registry.npmjs.org/cache-manager/-/cache-manager-5.7.6.tgz",
      "integrity": "sha512-wBxnBHjDxF1RXpHCBD6HGvKER003Ts7IIm0CHpggliHzN1RZditb7rXoduE1rplc2DEFYKxhLKgFuchXMJje9w==",
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "eventemitter3": "^5.0.1",
        "lodash.clonedeep": "^4.5.0",
@@ -5579,15 +5564,13 @@
      "version": "0.5.1",
      "resolved": "https://registry.npmjs.org/class-transformer/-/class-transformer-0.5.1.tgz",
      "integrity": "sha512-SQa1Ws6hUbfC98vKGxZH3KFY0Y1lm5Zm0SY8XX9zbK7FJCyVEac3ATW0RIpwzW+oOfmHE5PMPufDG9hCfoEOMw==",
-      "license": "MIT",
-      "peer": true
+      "license": "MIT"
    },
    "node_modules/class-validator": {
      "version": "0.14.1",
      "resolved": "https://registry.npmjs.org/class-validator/-/class-validator-0.14.1.tgz",
      "integrity": "sha512-2VEG9JICxIqTpoK1eMzZqaV+u/EiwEJkMGzTrZf6sU/fwsnOITVgYJ8yojSy6CaXtO9V0Cc6ZQZ8h8m4UBuLwQ==",
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "@types/validator": "^13.11.8",
        "libphonenumber-js": "^1.10.53",
@@ -6251,8 +6234,7 @@
      "version": "0.0.1425554",
      "resolved": "https://registry.npmjs.org/devtools-protocol/-/devtools-protocol-0.0.1425554.tgz",
      "integrity": "sha512-uRfxR6Nlzdzt0ihVIkV+sLztKgs7rgquY/Mhcv1YNCWDh5IZgl5mnn2aeEnW5stYTE0wwiF4RYVz8eMEpV1SEw==",
-      "license": "BSD-3-Clause",
-      "peer": true
+      "license": "BSD-3-Clause"
    },
    "node_modules/dezalgo": {
      "version": "1.0.4",
@@ -6529,6 +6511,7 @@
      "resolved": "https://registry.npmjs.org/encodeurl/-/encodeurl-2.0.0.tgz",
      "integrity": "sha512-Q0n9HRi4m6JuGIV1eFlmvJB7ZEVxu93IrMyiMsGC0lrMJMWzRgx6WGquyfQgZVb31vhGgXnfmPNNXmxnOkRBrg==",
      "license": "MIT",
+      "peer": true,
      "engines": {
        "node": ">= 0.8"
      }
@@ -6716,7 +6699,6 @@
      "deprecated": "This version is no longer supported. Please see https://eslint.org/version-support for other options.",
      "dev": true,
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "@eslint-community/eslint-utils": "^4.2.0",
        "@eslint-community/regexpp": "^4.6.1",
@@ -7063,6 +7045,7 @@
      "resolved": "https://registry.npmjs.org/express/-/express-4.21.2.tgz",
      "integrity": "sha512-28HqgMZAmih1Czt9ny7qr6ek2qddF4FclbMzwhCREB6OFfH+rXAnuNCwo1/wFvrtbgsQDb4kSbX9de9lFbrXnA==",
      "license": "MIT",
+      "peer": true,
      "dependencies": {
        "accepts": "~1.3.8",
        "array-flatten": "1.1.1",
@@ -7109,6 +7092,7 @@
      "resolved": "https://registry.npmjs.org/body-parser/-/body-parser-1.20.3.tgz",
      "integrity": "sha512-7rAxByjUMqQ3/bHJy7D6OGXvx/MMc4IqBn/X0fcM1QUcAItpZrBEYhWGem+tzXH90c+G01ypMcYJBO9Y30203g==",
      "license": "MIT",
+      "peer": true,
      "dependencies": {
        "bytes": "3.1.2",
        "content-type": "~1.0.5",
@@ -7133,6 +7117,7 @@
      "resolved": "https://registry.npmjs.org/cookie/-/cookie-0.7.1.tgz",
      "integrity": "sha512-6DnInpx7SJ2AK3+CTUE/ZM0vWTUboZCegxhC2xiIydHR9jNuTAASBrfEpHhiGOZw/nX51bHt6YQl8jsGo4y/0w==",
      "license": "MIT",
+      "peer": true,
      "engines": {
        "node": ">= 0.6"
      }
@@ -7142,6 +7127,7 @@
      "resolved": "https://registry.npmjs.org/debug/-/debug-2.6.9.tgz",
      "integrity": "sha512-bC7ElrdJaJnPbAP+1EotYvqZsb3ecl5wi6Bfi6BJTUcNowp6cvspg0jXznRTKDjm/E7AdgFBVeAPVMNcKGsHMA==",
      "license": "MIT",
+      "peer": true,
      "dependencies": {
        "ms": "2.0.0"
      }
@@ -7150,19 +7136,22 @@
      "version": "2.0.0",
      "resolved": "https://registry.npmjs.org/ms/-/ms-2.0.0.tgz",
      "integrity": "sha512-Tpp60P6IUJDTuOq/5Z8cdskzJujfwqfOTkrwIwj7IRISpnkJnT6SyJ4PCPnGMoFjC9ddhal5KVIYtAt97ix05A==",
-      "license": "MIT"
+      "license": "MIT",
+      "peer": true
    },
    "node_modules/express/node_modules/path-to-regexp": {
      "version": "0.1.12",
      "resolved": "https://registry.npmjs.org/path-to-regexp/-/path-to-regexp-0.1.12.tgz",
      "integrity": "sha512-RA1GjUVMnvYFxuqovrEqZoxxW5NUZqbwKtYz/Tt7nXerk0LbLblQmrsgdeOxV5SFHf0UDggjS/bSeOZwt1pmEQ==",
-      "license": "MIT"
+      "license": "MIT",
+      "peer": true
    },
    "node_modules/express/node_modules/qs": {
      "version": "6.13.0",
      "resolved": "https://registry.npmjs.org/qs/-/qs-6.13.0.tgz",
      "integrity": "sha512-+38qI9SOr8tfZ4QmJNplMUxqjbe7LKvvZgWdExBOmd+egZTtjLB67Gu0HRX3u/XOq7UU2Nx6nsjvS16Z9uwfpg==",
      "license": "BSD-3-Clause",
+      "peer": true,
      "dependencies": {
        "side-channel": "^1.0.6"
      },
@@ -7191,7 +7180,8 @@
          "url": "https://feross.org/support"
        }
      ],
-      "license": "MIT"
+      "license": "MIT",
+      "peer": true
    },
    "node_modules/external-editor": {
      "version": "3.1.0",
@@ -7426,6 +7416,7 @@
      "resolved": "https://registry.npmjs.org/finalhandler/-/finalhandler-1.3.1.tgz",
      "integrity": "sha512-6BN9trH7bp3qvnrRyzsBz+g3lZxTNZTbVO2EV1CS0WIcDbawYVdYvGflME/9QP0h0pYlCDBCTjYa9nZzMDpyxQ==",
      "license": "MIT",
+      "peer": true,
      "dependencies": {
        "debug": "2.6.9",
        "encodeurl": "~2.0.0",
@@ -7444,6 +7435,7 @@
      "resolved": "https://registry.npmjs.org/debug/-/debug-2.6.9.tgz",
      "integrity": "sha512-bC7ElrdJaJnPbAP+1EotYvqZsb3ecl5wi6Bfi6BJTUcNowp6cvspg0jXznRTKDjm/E7AdgFBVeAPVMNcKGsHMA==",
      "license": "MIT",
+      "peer": true,
      "dependencies": {
        "ms": "2.0.0"
      }
@@ -7452,7 +7444,8 @@
      "version": "2.0.0",
      "resolved": "https://registry.npmjs.org/ms/-/ms-2.0.0.tgz",
      "integrity": "sha512-Tpp60P6IUJDTuOq/5Z8cdskzJujfwqfOTkrwIwj7IRISpnkJnT6SyJ4PCPnGMoFjC9ddhal5KVIYtAt97ix05A==",
-      "license": "MIT"
+      "license": "MIT",
+      "peer": true
    },
    "node_modules/find-up": {
      "version": "5.0.0",
@@ -8246,7 +8239,6 @@
      "resolved": "https://registry.npmjs.org/ioredis/-/ioredis-5.6.1.tgz",
      "integrity": "sha512-UxC0Yv1Y4WRJiGQxQkP0hfdL0/5/6YvdfOOClRgJ0qppSarkhneSa6UvkMkms0AkdGimSH3Ikqm+6mkMmX7vGA==",
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "@ioredis/commands": "^1.1.1",
        "cluster-key-slot": "^1.1.0",
@@ -8588,7 +8580,6 @@
      "integrity": "sha512-Yn0mADZB89zTtjkPJEXwrac3LHudkQMR+Paqa8uxJHCBr9agxztUifWCyiYrjhMPBoUVBjyny0I7XH6ozDr7QQ==",
      "dev": true,
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "@jest/core": "^27.5.1",
        "import-local": "^3.0.2",
@@ -9878,6 +9869,7 @@
      "resolved": "https://registry.npmjs.org/merge-descriptors/-/merge-descriptors-1.0.3.tgz",
      "integrity": "sha512-gaNvAS7TZ897/rVaZ0nMtAyxNyi/pdbjbAwUpFQpN70GqnVfOiXpeUUMKRBmzXaSQ8DdTX4/0ms62r2K+hE6mQ==",
      "license": "MIT",
+      "peer": true,
      "funding": {
        "url": "https://github.com/sponsors/sindresorhus"
      }
@@ -10635,7 +10627,6 @@
      "resolved": "https://registry.npmjs.org/passport/-/passport-0.6.0.tgz",
      "integrity": "sha512-0fe+p3ZnrWRW74fe8+SvCyf4a3Pb2/h7gFkQ8yTJpAO50gDzlfjZUZTO1k5Eg9kUct22OxHLqDZoKUWRHOh9ug==",
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "passport-strategy": "1.x.x",
        "pause": "0.0.1",
@@ -11025,7 +11016,6 @@
      "integrity": "sha512-tdN8qQGvNjw4CHbY+XXk0JgCXn9QiF21a55rBe5LJAU+kDyC4WQn4+awm2Xfk2lQMk5fKup9XgzTZtGkjBdP9Q==",
      "dev": true,
      "license": "MIT",
-      "peer": true,
      "bin": {
        "prettier": "bin-prettier.js"
      },
@@ -11528,8 +11518,7 @@
      "version": "0.1.14",
      "resolved": "https://registry.npmjs.org/reflect-metadata/-/reflect-metadata-0.1.14.tgz",
      "integrity": "sha512-ZhYeb6nRaXCfhnndflDK8qI6ZQ/YcWZCISRAWICW9XYqMUwjZM9Z0DveWX/ABN01oxSHwVxKQmxeYZSsm0jh5A==",
-      "license": "Apache-2.0",
-      "peer": true
+      "license": "Apache-2.0"
    },
    "node_modules/relative-microtime": {
      "version": "2.0.0",
@@ -11716,7 +11705,6 @@
      "resolved": "https://registry.npmjs.org/rxjs/-/rxjs-7.8.2.tgz",
      "integrity": "sha512-dhKf903U/PQZY6boNNtAGdWbG85WAbjT/1xYoZIC7FAY0yWapOBQVsVrDl58W86//e1VpMNBtRV4MaXfdMySFA==",
      "license": "Apache-2.0",
-      "peer": true,
      "dependencies": {
        "tslib": "^2.1.0"
      }
@@ -11778,7 +11766,6 @@
      "resolved": "https://registry.npmjs.org/ajv/-/ajv-6.12.6.tgz",
      "integrity": "sha512-j3fVLgvTo527anyYyJOGTYJbG+vnnQYvE0m5mmkc1TK+nxAppkCLMIL0aZ4dblVCNoGShhm+kzE4ZUykBoMg4g==",
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "fast-deep-equal": "^3.1.1",
        "fast-json-stable-stringify": "^2.0.0",
@@ -11822,6 +11809,7 @@
      "resolved": "https://registry.npmjs.org/send/-/send-0.19.0.tgz",
      "integrity": "sha512-dW41u5VfLXu8SJh5bwRmyYUbAoSB3c9uQh6L8h/KtsFREPWpbX1lrljJo186Jc4nmci/sGUZ9a0a0J2zgfq2hw==",
      "license": "MIT",
+      "peer": true,
      "dependencies": {
        "debug": "2.6.9",
        "depd": "2.0.0",
@@ -11846,6 +11834,7 @@
      "resolved": "https://registry.npmjs.org/debug/-/debug-2.6.9.tgz",
      "integrity": "sha512-bC7ElrdJaJnPbAP+1EotYvqZsb3ecl5wi6Bfi6BJTUcNowp6cvspg0jXznRTKDjm/E7AdgFBVeAPVMNcKGsHMA==",
      "license": "MIT",
+      "peer": true,
      "dependencies": {
        "ms": "2.0.0"
      }
@@ -11854,13 +11843,15 @@
      "version": "2.0.0",
      "resolved": "https://registry.npmjs.org/ms/-/ms-2.0.0.tgz",
      "integrity": "sha512-Tpp60P6IUJDTuOq/5Z8cdskzJujfwqfOTkrwIwj7IRISpnkJnT6SyJ4PCPnGMoFjC9ddhal5KVIYtAt97ix05A==",
-      "license": "MIT"
+      "license": "MIT",
+      "peer": true
    },
    "node_modules/send/node_modules/encodeurl": {
      "version": "1.0.2",
      "resolved": "https://registry.npmjs.org/encodeurl/-/encodeurl-1.0.2.tgz",
      "integrity": "sha512-TPJXq8JqFaVYm2CWmPvnP2Iyo4ZSM7/QKcSmuMLDObfpH5fi7RUGmd/rTDf+rut/saiDiQEeVTNgAmJEdAOx0w==",
      "license": "MIT",
+      "peer": true,
      "engines": {
        "node": ">= 0.8"
      }
@@ -11869,7 +11860,8 @@
      "version": "2.1.3",
      "resolved": "https://registry.npmjs.org/ms/-/ms-2.1.3.tgz",
      "integrity": "sha512-6FlzubTLZG3J2a/NVCAleEhjzq5oxgHyaCU9yYXvcLsvoVaHJq/s5xXI6/XXP6tz7R9xAOtHnSO/tXtF3WRTlA==",
-      "license": "MIT"
+      "license": "MIT",
+      "peer": true
    },
    "node_modules/serialize-javascript": {
      "version": "6.0.2",
@@ -11885,6 +11877,7 @@
      "resolved": "https://registry.npmjs.org/serve-static/-/serve-static-1.16.2.tgz",
      "integrity": "sha512-VqpjJZKadQB/PEbEwvFdO43Ax5dFBZ2UECszz8bQ7pi7wt//PWe1P6MN7eCnjsatYtBT6EuiClbjSWP2WrIoTw==",
      "license": "MIT",
+      "peer": true,
      "dependencies": {
        "encodeurl": "~2.0.0",
        "escape-html": "~1.0.3",
@@ -12862,7 +12855,6 @@
      "integrity": "sha512-f0FFpIdcHgn8zcPSbf1dRevwt047YMnaiJM3u2w2RewrB+fob/zePZcrOyQoLMMO7aBIddLcQIEK5dYjkLnGrQ==",
      "dev": true,
      "license": "MIT",
-      "peer": true,
      "dependencies": {
        "@cspotcode/source-map-support": "^0.8.0",
        "@tsconfig/node10": "^1.0.7",
@@ -13092,7 +13084,6 @@
      "resolved": "https://registry.npmjs.org/typescript/-/typescript-4.9.5.tgz",
      "integrity": "sha512-1FXk9E2Hm+QzZQ7z+McJiHL4NW1F2EzMu9Nq9i3zAaGqibafqYwCVU6WyWAuyQRRzOlxou8xZSyXLEN8oKj24g==",
      "license": "Apache-2.0",
-      "peer": true,
      "bin": {
        "tsc": "bin/tsc",
        "tsserver": "bin/tsserver"
@@ -13420,6 +13411,7 @@
      "resolved": "https://registry.npmjs.org/schema-utils/-/schema-utils-4.3.0.tgz",
      "integrity": "sha512-Gf9qqc58SpCA/xdziiHz35F4GNIWYWZrEshUc/G/r5BnLph6xpKuLeoJoQuj5WfBIx/eQLf+hmVPYHaxJu7V2g==",
      "license": "MIT",
+      "peer": true,
      "dependencies": {
        "@types/json-schema": "^7.0.9",
        "ajv": "^8.9.0",
@@ -30,7 +30,7 @@
    "@aws-sdk/client-secrets-manager": "^3.414.0",
    "@dadosfera/dadosfera-logs": "^1.0.0-beta.4",
    "@dadosfera/protospack": "2.5.3",
-    "@dadosfera/protospack-v2": "3.38.0-beta.14",
+    "@dadosfera/protospack-v2": "3.38.0-beta.16",
    "@grpc/grpc-js": "^1.9.3",
    "@grpc/proto-loader": "^0.7.9",
    "@nestjs/cli": "^9.5.0",
@@ -13,6 +13,7 @@ import {
  Req,
  Param,
  Res,
+  UnauthorizedException,
 } from '@nestjs/common';
 import {
  ApiHeaders,
@@ -102,14 +103,13 @@ export class AuthController {
      const data = await this.authClient.signIn({ username, password, totp }, metadata);

      if (data.tokens) {
-        this.addTokenInCookie(res, {
+        this.authClient.writeAuthSession(res, {
          accessToken: data.tokens.accessToken,
          refreshToken: data.tokens.refreshToken,
          userId: data.user.id
        });
      }

-
      return res.send(data);
    } catch (error) {
      this.logger.error('/auth - SignIn - ERROR', error);
@@ -126,27 +126,8 @@ export class AuthController {
  ) {
    try {
      this.logger.info('/auth - SignOut');
-      const exp = 1000 * 60 * 3;
-
-      res.cookie('ddf-auth', '', {
-        domain: 'dadosfera.local',
-        maxAge: Date.now() - exp,
-        expires: new Date(),
-        httpOnly: true,
-        secure: true,
-        sameSite: 'none', // Necessário para cookies em requisições cross-site
-      });
-
-      res.cookie('ddf-refresh-auth', '', {
-        domain: 'dadosfera.local',
-        maxAge: Date.now() - exp,
-        expires: new Date(),
-        httpOnly: true,
-        secure: true,
-        sameSite: 'none', // Necessário para cookies em requisições cross-site
-      });
-
-      this.logger.info('Clean cookie sessions');
+   
+      this.authClient.cleanUpAuthSession(res);

      return res.send();
    } catch (error) {
@@ -175,8 +156,9 @@ export class AuthController {

    const data = await this.authClient.refreshAccessToken({ refreshToken, userId }, metadata);

-    this.addTokenInCookie(res, {
+    this.authClient.writeAuthSession(res, {
      accessToken: data.accessToken,
+      refreshToken: data.refreshToken,
      userId
    });

@@ -492,85 +474,36 @@ export class AuthController {
  @Get('me')
  async getMe(@Req() req: Request, @Res() res: Response) {
    this.logger.info('GET /auth/me ')
-    // Lê cookies
+
+    // Get token and headers
    const accessToken = req.cookies['ddf-auth'];
-    const userId = req.cookies['ddf-user-id'];
+    const refreshToken = req.cookies['ddf-refresh-auth']; 
+    const userId = req.cookies['ddf-user-id']; 
+    const resourceHost = req.headers["host"]
+
+    const hasUserSession = Boolean(accessToken) && Boolean(userId);
+    this.logger.info('Has User Session: ' + hasUserSession);
+
+    if (!hasUserSession) {
+      throw new UnauthorizedException()
+    }

-    this.logger.info('Has cookie: ' + Boolean(accessToken))
    try {
-      // Decodifica e valida o JWT de acesso
-      const userDto = await this.authClient.extractUserFrom(accessToken);
+      const userDto = await this.authClient.validateUserSession(accessToken, resourceHost);
      return res.status(200).json(userDto);
-    } catch (err) {
-      this.logger.error(err.message);
-      const refreshToken = req.cookies['ddf-refresh-auth'];
+    } catch (error) {

-      this.logger.info('Token is invalid')
-      this.logger.info('Has Refresh Token: '+ Boolean(refreshToken))
-      // Se access token inválido, tenta refresh
-      if (!refreshToken || !userId) {
+      if (!refreshToken) {
        this.logger.error('Invalid refresh token or customer name');
-        return res.status(401).json({ error: 'Not authenticated' });
-      }
-      try {
-        // Chama refreshAccessToken
-        const metadata = PackTheMetadata({
-        });
-        this.logger.info('Call Refresh Token')
-        const data = await this.authClient.refreshAccessToken({ refreshToken, userId }, metadata);
-        this.logger.info('Finish Refresh Token')
-        // Retorna novo access token e dados mínimos
-        this.addTokenInCookie(res, {
-          accessToken: data.accessToken,
-          userId
-        });
-        // Decodifica novo token
-        const userDto = await this.authClient.extractUserFrom(accessToken);
-        return res.status(200).json(userDto);
-      } catch (refreshErr) {
-        this.logger.error(refreshErr)
-        return res.status(401).json({ error: 'Not authenticated' });
-      }
-    }
-  }
+        throw new UnauthorizedException("Invalid refresh token or customer name");
+      };

-  private addTokenInCookie(res: Response, data: CookiesValues) {
-    let exp = 1000 * 60 * 5; // 5 minutes
-
-    if (data.accessToken) {
-      const { exp: expiration } = jwt.decode(data.accessToken) as JwtPayload;
-      exp = (expiration - 30) * 1000; // exp em segundos, maxAge em ms
-
-      this.logger.info('Set Cookie ddf-auth')
-      res.cookie('ddf-auth', data.accessToken, {
-        domain: '.dadosfera.ai',
-        maxAge: exp,
-        httpOnly: true,
-        secure: true,
-        sameSite: 'none', // Necessário para cookies em requisições cross-site
-      });
-    }
-
-    if (data.refreshToken) {
-      this.logger.info('Set Cookie ddf-refresh-auth')
-      res.cookie('ddf-refresh-auth', data.refreshToken, {
-        domain: '.dadosfera.ai',
-        maxAge: exp,
-        httpOnly: true,
-        secure: true,
-        sameSite: 'none', // Necessário para cookies em requisições cross-site
-      });
-    }
-
-    if (data.userId) {
-      this.logger.info('Set Cookie ddf-refresh-auth')
-      res.cookie('ddf-user-id', data.userId, {
-        domain: '.dadosfera.ai',
-        maxAge: exp,
-        httpOnly: true,
-        secure: true,
-        sameSite: 'none', // Necessário para cookies em requisições cross-site
-      });
+      const {
+        authSession,
+        user
+      } = await this.authClient.refreshUserSession(refreshToken, userId, resourceHost);
+      this.authClient.writeAuthSession(res, authSession);
+      return res.status(200).json(user);
    }
  }
 }
@@ -1,10 +1,20 @@
-import { OnModuleInit, Inject, Injectable, ForbiddenException } from '@nestjs/common';
+import {
+  OnModuleInit,
+  Inject,
+  Injectable,
+  ForbiddenException,
+  HttpException,
+  HttpStatus,
+} from '@nestjs/common';
 import { ClientGrpc } from '@nestjs/microservices';
 import { DadosferaLogger } from '@dadosfera/dadosfera-logs';
 import { lastValueFrom } from 'rxjs';

 import { ProtoServices } from '@dadosfera/protospack-v2/dist/lib/Duc';
-import { AuthProtoService as AuthServiceInterface, IdentityProviderProtoService, UsersProtoService } from '@dadosfera/protospack-v2/dist/lib/Duc/interfaces/write-service';
+import {
+  AuthProtoService as AuthServiceInterface,
+  UsersProtoService,
+} from '@dadosfera/protospack-v2/dist/lib/Duc/interfaces/write-service';
 import {
  AuthSnowflakeSignInRequest,
  AuthSignInRequest,
@@ -22,12 +32,18 @@ import {
 import { DucClient } from '../duc/client.config';
 import { Metadata } from '@grpc/grpc-js';
 import { BulkEditResponse, UserDTO } from './dtos/login';
-import jwt from 'jsonwebtoken';
+import jwt, { JwtPayload } from 'jsonwebtoken';
 import { PackTheMetadata } from 'src/utils/PackTheMetadata';
+import { Request, Response } from 'express';
+
+type AuthSession = {
+  accessToken?: string;
+  refreshToken?: string;
+  userId?: string;
+};

@Injectable()
 export class AuthClientService implements OnModuleInit {
-
  logger: DadosferaLogger;

  private authService: AuthServiceInterface;
@@ -63,11 +79,11 @@ export class AuthClientService implements OnModuleInit {
    return lastValueFrom(this.authService.AuthSnowflakeSignIn(input));
  }

-  checkDedicatedProxy({
-    customer
-  }: AuthSignInResponse) {
+  checkDedicatedProxy({ customer }: AuthSignInResponse) {
    const DEDICATED_PROXY = process.env.DEDICATED_PROXY || '';
-    this.logger.info('SignIn - Setting customer ID for dedicated proxy: ' + DEDICATED_PROXY);
+    this.logger.info(
+      'SignIn - Setting customer ID for dedicated proxy: ' + DEDICATED_PROXY,
+    );
    this.logger.info('Customer ID: ' + customer.id);

    if (DEDICATED_PROXY !== '' && DEDICATED_PROXY !== customer.id) {
@@ -75,7 +91,9 @@ export class AuthClientService implements OnModuleInit {
    }

    // Bloquear o customer de acesso o maestro publico
-    this.logger.info('Check if customer have network policy: ' + customer.modules);
+    this.logger.info(
+      'Check if customer have network policy: ' + customer.modules,
+    );
    const hasNetworkPolicyModule = customer.modules.includes('network-policy');
    if (hasNetworkPolicyModule && DEDICATED_PROXY === '') {
      throw new ForbiddenException();
@@ -94,7 +112,6 @@ export class AuthClientService implements OnModuleInit {
      result = await lastValueFrom(
        this.authService.AuthSignIn({ username, password, totp }, metadata),
      );
-
    } catch (error) {
      this.logger.error('SignIn - Error during sign-in');
      this.logger.error(error);
@@ -105,7 +122,7 @@ export class AuthClientService implements OnModuleInit {
      this.checkDedicatedProxy(result);
    }

-    return result
+    return result;
  }

  async refreshAccessToken(
@@ -115,7 +132,10 @@ export class AuthClientService implements OnModuleInit {
    this.logger.info('RefreshAccessToken');

    return lastValueFrom(
-      this.authService.AuthRefreshAccessToken({ refreshToken, userId }, metadata),
+      this.authService.AuthRefreshAccessToken(
+        { refreshToken, userId },
+        metadata,
+      ),
    );
  }

@@ -284,50 +304,189 @@ export class AuthClientService implements OnModuleInit {
    }
  }

-  private async getUser(id: string, metadata: Metadata) {
-    this.logger.info('getUser');
-    return await lastValueFrom(
-      this.userService.UserFindOneById({ id }, metadata),
-    );
+  public async validateUserSession(accessToken: any, resourceHost: string) {
+    const payload = await this.validateJwtToken(accessToken);
+
+    const userDto = await this.getUserfromPayload(payload);
+
+    this.validateResourceAccess(resourceHost, userDto);
+    return userDto;
  }

-  public async extractUserFrom(token: string) {
-      const decoded: any = token && jwt.decode(token, { complete: true });
-      if (!decoded) throw new Error('Invalid token');
+  public async refreshUserSession(
+    refreshToken: string,
+    userId: string,
+    originHeader: string,
+  ): Promise<{
+    user: UserDTO;
+    authSession: AuthSession;
+  }> {
+    const metadata = PackTheMetadata({});

-      const { kid } = decoded.header;
-      // Busca a chave pública
-      const { keys } = await this.getPublicKeys();
-      const pemValue = keys.find((k) => k.kid === kid)?.pem;
-      if (!pemValue)
-          throw new Error('Public key not found');
-      jwt.verify(token, pemValue);
+    this.logger.info('Call Refresh Token');
+    const refreshCredentials = await this.refreshAccessToken(
+      { refreshToken, userId },
+      metadata,
+    );
+    this.logger.info('Finish Refresh Token');

-      const payload = decoded.payload;
-      const metadata = PackTheMetadata({
-        customer_id: payload.customer_id
-      })
+    const userDto = await this.validateUserSession(
+      refreshCredentials.accessToken,
+      originHeader,
+    );
+    return {
+      user: userDto,
+      authSession: {
+        accessToken: refreshCredentials.accessToken,
+        refreshToken: refreshCredentials.refreshToken,
+        userId,
+      },
+    };
+  }

-      const {
-        user
-      } = await this.getUser(
-        payload.user_id,
-        metadata
-      );
+  public writeAuthSession(res: Response, data: AuthSession) {
+    let exp = 1000 * 60 * 5; // 5 minutes

-      const userDto: UserDTO = {
-          id: user.id,
-          name: user.username,
-          jobTitle: user?.jobTitle || null,
-          department: user?.department || null,
-          hierarchy: user?.hierarchy || null,
-          customer: {
-            id: payload.customer_id,
-            name: payload.customer_name,
-            tier: payload.customer_tier,
-          }
-        };
+    if (data.accessToken) {
+      const { exp: expiration } = jwt.decode(data.accessToken) as JwtPayload;
+      exp = (expiration - 30) * 1000; // exp em segundos, maxAge em ms

-      return userDto;
+      this.logger.info('Set Cookie ddf-auth');
+      res.cookie('ddf-auth', data.accessToken, {
+        domain: '.dadosfera.ai',
+        maxAge: exp,
+        httpOnly: true,
+        secure: true,
+        sameSite: 'none', // Necessário para cookies em requisições cross-site
+      });
    }
+
+    if (data.refreshToken) {
+      this.logger.info('Set Cookie ddf-refresh-auth');
+      res.cookie('ddf-refresh-auth', data.refreshToken, {
+        domain: '.dadosfera.ai',
+        maxAge: exp,
+        httpOnly: true,
+        secure: true,
+        sameSite: 'none', // Necessário para cookies em requisições cross-site
+      });
+    }
+
+    if (data.userId) {
+      this.logger.info('Set Cookie ddf-refresh-auth');
+      res.cookie('ddf-user-id', data.userId, {
+        domain: '.dadosfera.ai',
+        maxAge: exp,
+        httpOnly: true,
+        secure: true,
+        sameSite: 'none', // Necessário para cookies em requisições cross-site
+      });
+    }
+  }
+
+  public cleanUpAuthSession(res: Response) {
+    const exp = 1000 * 60 * 3;
+
+    res.cookie('ddf-auth', '', {
+      domain: 'dadosfera.ai',
+      maxAge: Date.now() - exp,
+      expires: new Date(),
+      httpOnly: true,
+      secure: true,
+      sameSite: 'none', // Necessário para cookies em requisições cross-site
+    });
+
+    res.cookie('ddf-refresh-auth', '', {
+      domain: 'dadosfera.ai',
+      maxAge: Date.now() - exp,
+      expires: new Date(),
+      httpOnly: true,
+      secure: true,
+      sameSite: 'none', // Necessário para cookies em requisições cross-site
+    });
+
+    this.logger.info('Clean cookie sessions');
+  }
+
+  private async validateJwtToken(token: string) {
+    const decoded: any = token && jwt.decode(token, { complete: true });
+    if (!decoded) throw new Error('Invalid token');
+
+    const { kid } = decoded.header;
+    // Busca a chave pública
+    const { keys } = await this.getPublicKeys();
+    const pemValue = keys.find((k) => k.kid === kid)?.pem;
+    if (!pemValue) throw new Error('Public key not found');
+    jwt.verify(token, pemValue);
+
+    return decoded.payload;
+  }
+
+  private async getUserfromPayload(payload: JwtPayload): Promise<UserDTO> {
+    this.logger.info('getUser');
+
+    const metadata = PackTheMetadata({
+      customer_id: payload.customer_id,
+    });
+
+    const { user } = await lastValueFrom(
+      this.userService.UserFindOneById({ id: payload.user_id }, metadata),
+    );
+
+    const userDto: UserDTO = {
+      id: user.id,
+      name: user.username,
+      jobTitle: user?.jobTitle || null,
+      department: user?.department || null,
+      hierarchy: user?.hierarchy || null,
+      customer: {
+        id: payload.customer_id,
+        name: payload.customer_name,
+        tier: payload.customer_tier,
+      },
+    };
+
+    return userDto;
+  }
+
+  private validateResourceAccess(host: string, user: UserDTO) {
+    this.logger.info(
+      "Validate whether the source URL is a resource belonging to the user's client",
+    );
+    this.logger.info('Host: ' + host);
+    this.logger.info('Customer: ' + user.customer.name);
+
+    const hostParts = host.split('.');
+    const domain = hostParts[0];
+    const isResouceStg = hostParts[1] === 'stg';
+
+    const notFoundCustomerInDomain = !domain.includes('-')
+
+    if (notFoundCustomerInDomain) {
+      this.logger.info(`Not found Customer Name in domain`);
+      return;
+    }
+
+    const domainParts = domain.split('-');
+
+    const customerInDomain = domainParts[domainParts.length - 1];
+
+    if (isResouceStg && process.env.ENV !== 'stg') {
+      this.logger.error(`Customer ${user.customer.name} cannot access ${host}`);
+      throw new HttpException(
+        `Customer ${user.customer.name} cannot access ${host}`,
+        HttpStatus.FORBIDDEN
+      );
+    }
+
+    if (customerInDomain != user.customer.name) {
+      this.logger.error(`Customer ${user.customer.name} cannot access ${host}`);
+      throw new HttpException(
+        `Customer ${user.customer.name} cannot access ${host}`,
+        HttpStatus.FORBIDDEN
+      );
+    }
+
+    return;
+  }
 }
@@ -423,6 +423,7 @@ export class CatalogController {
    @User() user: RequestUser,
    @Language() language: LanguageEnum,
    @Param('id') id: string,
+    @Query('asset_type') asset_type: string,
  ): Promise<IDocsResponse> {
    const { customer_name, customer_id, user_id, username } = user;

@@ -439,7 +440,7 @@ export class CatalogController {
      language,
    });

-    const docs = await this.catalogService.getDataDocs(id, metadata);
+    const docs = await this.catalogService.getDataDocs(id, asset_type, metadata);

    return { docs };
  }
@@ -487,21 +488,32 @@ export class CatalogController {
    @Headers() headers,
    @Param('id') table_id: string,
    @Body('docs') docs: string,
+    @Query('asset_type') asset_type: string,
  ) {
-    const { user_id, customer_name } = user;
+    const { user_id, customer_name, customer_id, username } = user;
+    
+    const metadata = PackTheMetadata({
+      customer_id,
+      customer_name,
+      user_id,
+      username,
+    });

-    this.logger.info(`/catalog - ON GET DATA DOCS ROUTE`, {
+    this.logger.info(`/catalog - ON POST DATA DOCS ROUTE`, {
      user_id,
      customer_name,
    });

-    const res = await this.catalogService.createDataDocs({
+    const body = {
      table_id,
      docs,
+      asset_type,
      info: {
        customer: customer_name,
      },
-    });
+    }
+
+    const res = await this.catalogService.createDataDocs(body, metadata);

    return res;
  }
@@ -24,9 +24,11 @@ import { CatalogClientConfiguration } from './catalog-client';
 import { UsersService } from '../users/users.service';
 import { RolesService } from '../roles/roles.service';
 import { Metadata } from '@grpc/grpc-js';
+import { PackTheMetadata } from 'src/utils/PackTheMetadata';
 import {
  AssetReporter,
  BatchRemoveRlsRulesRequest,
+  CreateDataDocsDTO,
  IUpdateDataRequest,
  TriggerCatalogReq,
 } from './dtos';
@@ -337,9 +339,9 @@ class CatalogService implements OnModuleInit {
    return { data_asset: asset[0] };
  }

-  async getDataDocs(id: string, metadata: Metadata) {
+  async getDataDocs(id: string, assetType: string, metadata: Metadata) {
    const { documentation } = await lastValueFrom(
-      this.catalogReadService.GetDatasetDoc({ id, type: undefined }, metadata),
+      this.catalogReadService.GetDatasetDoc({ id }, metadata),
    );
 
    const docs = JSON.parse(documentation);
@@ -368,7 +370,16 @@ class CatalogService implements OnModuleInit {
    return result;
  }

-  async createDataDocs(body) {
+  async createDataDocs(body: CreateDataDocsDTO, metadata: Metadata) {
+    if (body.asset_type === 'table' || body.asset_type === 'view') {
+      return this.createDataDocsViaNimbus(body);
+    }
+    
+    return this.createDataDocsViaGrpc(body, metadata);
+  }
+
+  private async createDataDocsViaNimbus(body: CreateDataDocsDTO) {
+    this.logger.info('Creating data docs via Nimbus for table/view');
    const nimbusUrl = this._getNimbusUrl(body);
    const { data } = await axios.post(
      `${nimbusUrl}/api/catalog/data-docs/`,
@@ -377,6 +388,30 @@ class CatalogService implements OnModuleInit {
    return data;
  }

+  private async createDataDocsViaGrpc(body: CreateDataDocsDTO, metadata: Metadata) {
+    this.logger.info('Creating data docs via gRPC for other asset types');
+    try {
+      const response: any = await lastValueFrom(
+        this.catalogWriteService.UpdateDataAssetDoc(
+          {
+            id: body.table_id,
+            docs: body.docs,
+          },
+          metadata,
+        ),
+      );
+      
+      return response;
+      
+    } catch (error) {
+      this.logger.error('Error creating data asset docs:', error);
+      throw new HttpException(
+        'Failed to create data asset documentation',
+        HttpStatus.INTERNAL_SERVER_ERROR,
+      );
+    }
+  }
+
  async findAllTags(data, metadata) {
    this.logger.info('CatalogService - findAllCustomerTags');

@@ -328,3 +328,10 @@ export type AssetReporter = {
  created_at: string;
  tags: string;
 }
+
+export type CreateDataDocsDTO = {
+  table_id: string;
+  docs: string;
+  asset_type: string;
+
+}
@@ -160,7 +160,7 @@ export class ShareService implements OnModuleInit {
    });

    const { documentation } = await lastValueFrom(
-      this.catalogReadService.GetDatasetDoc({ id, type: undefined }, metadata),
+      this.catalogReadService.GetDatasetDoc({ id }, metadata),
    );
    console.log(documentation);
    const docs = JSON.parse(documentation);
@@ -14,7 +14,7 @@ import { redisStore } from 'cache-manager-ioredis-yet';
          keyPrefix: 'maestro:sso',
        }

-        if (process.env.ENV !== 'local') {  
+        if (process.env.REDIS_TLS === 'true') {
          baseRedisConfig['tls'] = {
            servername: process.env.REDIS_HOST,
          }
Author	SHA1	Message	Date
viniciusgadea	09dced9fcd	REFACTOR: add asset_type query parameter to getDataDocs and separate data docs methods	2025-12-10 11:21:46 -03:00
viniciusgadea	165b533172	FIX: removing unnecessary type parameter from GetDatasetDoc call	2025-12-10 11:17:43 -03:00
viniciusgadea	b1dc567394	DOCS: update @dadosfera/protospack-v2 to version 3.38.0-beta.16	2025-12-10 11:12:13 -03:00
viniciusgadea	a0a1303515	DOCS: add automatic asset_type query parameter to API schema and packages dependencies	2025-12-09 14:56:51 -03:00
viniciusgadea	c21d977f7c	FEAT: enhance catalog service to support any asset type in data docs creation	2025-12-09 14:56:51 -03:00
viniciusgadea	399d3492d3	DOCS: update @dadosfera/protospack-v2 to version 3.38.0-beta.15	2025-12-09 14:56:51 -03:00
Marcos Rodrigues Silva	b0b557246e	Merge pull request #403 from dadosfera/feat/user-properties FIX: change origin to host	2025-12-03 15:26:10 -03:00
Marcos Rodrigues	bb671a90d6	FIX: change origin to host	2025-12-03 15:20:41 -03:00
Marcos Rodrigues Silva	f6ababbe7a	Merge pull request #402 from dadosfera/feat/user-properties FIX: using header host	2025-12-03 14:46:14 -03:00
Marcos Rodrigues	82290285d0	FIX: using header host	2025-12-03 14:41:51 -03:00
Marcos Rodrigues Silva	c490814a98	Merge pull request #401 from dadosfera/feat/user-properties FEAT: add resource origin validate in me endpoint	2025-12-03 13:53:33 -03:00
Marcos Rodrigues	7616b1e32c	FEAT: add resource origin validate in me endpoint	2025-12-03 13:51:32 -03:00
Rafael Santana	3ba2c91893	Merge pull request #400 from dadosfera/fix/redis-tls-configurable UPDATE: force deployment	2025-12-02 15:30:03 -03:00
Rafael	e789076ed4	UPDATE: force deployment	2025-12-02 15:29:36 -03:00
Rafael Santana	3b6ddaaee6	Merge pull request #399 from dadosfera/fix/redis-tls-configurable fix: make Redis TLS configurable via REDIS_TLS env var	2025-12-02 15:18:05 -03:00
RafaelandClaude	8073194604	fix: make Redis TLS configurable via REDIS_TLS env var - Change TLS check from ENV !== 'local' to REDIS_TLS === 'true' - Add REDIS_TLS env var to Helm deployment template - Default to true for OCI Redis, can override for self-hosted K8s 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>	2025-12-02 15:10:31 -03:00