MS Fabric - Iceberg Integration Guide via Amazon S3

How to Raise a Request

Submit request via https://services.nagra.com/SignIn.

Register a New App

1. Navigate to App Registrations

   1. Go to https://portal.azure.com.

   2. Search for "App registrations" in the search bar or find it under "Azure services".

   3. Click on "App registrations".

2. Start New Registration

   • Click "+ New registration" at the top of the page.

3. Configure Basic Settings

   • Name: enter a display name for your application

   • Supported account types: choose the following option:

     • Accounts in this organizational directory only (Single tenant only - Kudelski group)

4. Set Redirect URI

   • Keep this empty

5. Register

   • Click "Register" button

6. Post-Registration (Important Information)

   • Note the Application (client) ID - you'll need this

   • Note the Directory (tenant) ID - you'll need this

7. Create Client Secret

   1. Go to "Certificates & secrets".

   2. Click "+ New client secret".

   3. Add description and expiration period.

   4. Click "Add".

   5. Copy the secret value immediately – it won't be shown again.

8. Get the ObjectID of the newly created app:

   1. Go to Enterprise Application.

   2. Search with application name.

   3. Copy the Object ID.

Get IAM Role

1. Share the following details with AWS Integrator:

   • EntraTenantId

   • Object ID

   • clientid

2. Receive from AWS Integrator:

   • S3 bucket URL

   • IAM Role ARN

Create Table Short in Lakehouse

1. Navigate to Your Lakehouse:

   1. Open Microsoft Fabric (https://app.fabric.microsoft.com).

   2. Go to your workspace.

   3. Click on “+New Item” on top left corner. It will open a new window.

   4. Select Lakehouse.

   5. Give a appropriate lakehouse name and select checkbox “Lakehouse Schemas”.

   6. Open your newly-created Lakehouse.

2. Access Shortcut Creation:

   1. In the Lakehouse Explorer, locate the "Tables" section.

   2. Click on the "..." (three dots) or right-click on "Tables".

   3. Select "New Schema" from the menu.

   4. Give an appropriate schema name and click on create. This will create a new schema under the Table.

   5. Now click on the “…“ under the new table and select “New table shortcut”.

3. Choose Data Source

   1. Select the type of external data source:

      • Amazon S3 (AWS)

   2. Click on “New Connection” and provide the following details:

      • URL : S3 URL provided by integrator

      • roleARN : IAM Role ARN provided by integrator

      • Connection Name : Give an appropriate name

      • Date Gateway : None

      • Authentication Kind : Service Principal

      • Tenant ID : EntraTenantID

      • Service principal Client ID : Clienid

      • Service principal key : client secret

   3. Click on Next.

   4. Browse and Select Table Location:

      1. Navigate through your S3 bucket folder structure.

      2. Locate the folder containing your table data.

      3. Select the folder with Parquet files you want to expose as a table.

      4. Click “Create”.

   5. Verify the Shortcut:

      • The table shortcut appears under "Tables"/”New Schema Name” with a shortcut icon.

      • Test query: Right-click → "New SQL query" → Run SELECT * FROM [schema_name].[table_name] LIMIT 10