Use Data from Amazon S3 in Data Designer

Select a File

To select an S3 File:

1. Click the Object name you wish to import and you will be navigated to the File Selection page.
2. Select the required file and click Continue. You will be navigated to the Properties page, where you can select the below mentioned properties.

1. Use Date Pattern: Select this to use Date Pattern in the file path. After you select the Use Date Pattern checkbox, you can see the below options:

   • Sample File Name: Displays the Sample File Name.

   • Honor Date Pattern: Select this to Honor the selected date pattern in the File Name. 

   • Select or Enter Date Pattern: You can search or select the required date pattern from the dropdown list. You can also type-in the custom date pattern as required.

   • Fetch Data: You can select the number of days to fetch data before the schedule runs.

2. File Separator: You can use this option if you want to ingest data from multiple files with similar file names into the S3 Dataset. You can use Comma, Pipe, Semicolon, Space or Tab as required.
3. Text Qualifier: It is used to import a value (along with special characters) specified in the Quotation while importing data. You can select either Double Quote or Single Quote as required.   
4. Escape Char: It is used to include a special character in the value and it is placed before a special character in the value. You can select Backslash, Double Quote or Single Quote as required.   
5. Compression Type: Select the Compression format. You can select None, .bzip or .gzip as required. 
6. Char Encoding: Select the required Char Encoding. You can select UTF-8, 16, 16BE, ASCII, ISO-8859-1,5589-2,5589-3 as required.
   However, Gainsight recommends that you set the file properties as shown below:
   
7. Is the source file encrypted: Select this if the csv file in the S3 bucket is encrypted. After you select the Is the source file encrypted checkbox, the Available Keys option is enabled and you can select the correct PGP key to apply decryption on the csv/tsv file.
8. Archive File: Select the Archive File checkbox to archive the S3 file after use. You must specify a path for the archived folder. A new folder is created in the specified path.
   
   By default, the archived folder is created at the same level at which the source file is located. For example, if your source CSV file is located immediately in the S3 bucket and not nested in any folder, the archived folder is created at the immediate level in the S3 bucket. If your source CSV file is nested in a folder, the archived folder is also created at the nested level. You can modify the default path, if required.
9. Click Save and Import. You will now be navigated to the Select Fields tab.

Select a Folder

To select a Folder:

1. Hover on the Object Name (Folder Name) you wish to import and click Select Folder. 
   Note: You can Search an Object by its name. In the Search by object name textbox, type in the Object name you want to search for. The Search operation works with the objects available in the S3 bucket.
2. Click Continue and you will be navigated to the Properties page, where you can select the properties.      
3. Click Save and Import. You will be navigated to the Select Fields tab. 

Fields

You can see the following options in the Fields tab:

1. Enter Dataset Name: In the Enter Dataset Name textbox, type In the Dataset Name, if you want to edit the Dataset Name. 
2. Search Fields: In the Search Fields textbox, type in the Field Name you want to search for. The Search operation works with the fields available in the Dataset.
3. Add Fields: Click Add Fields to select the required fields you want to add to the dataset, and then click Select. You can also remove fields from the dataset by deselecting them.

4. +Add Custom Field: If you want to create new fields in the dataset that are not available in the S3 file, click +Add Custom Field. To create new fields:

   1. Enter the Field Name.
   2. Select the Data Type. 
   3. Enter the Display Name. 
   4. Click Save. A Warning dialog appears.
   5. Click Yes Save to save the new field. 

5. Data Type: You can select and change the Field Data Type.
6. Display Name: By default, Field Name name appears in the Display Name textbox; if required you can modify it. Display Names are shown in the Datasets/reports. 
7. Settings: This option is available only for Date, Number and DateTime data types only. Click the Settings icon to enter/set the decimal places, date and time format.
   1. For the Date data type fields, you can set the Date Format.
   2. For the Number data type fields, you can set the Decimal Places. 
   3. For the DateTime data type fields, you can set Date Time Format and Time Zone. 
8. Delete: Click the Delete icon to delete a field from the dataset.
9. Save: Click Save to save the changes made in the dataset.

File Properties

You can see the following options in the File Properties tab:

1. Date Pattern: Select this to use Date Pattern in the file path. For more information, refer to the Select a File Step 2a.
2. Default Date Format: You can set the Default Date Format by searching or selecting the required pattern from the Date Format, Date Time Format and Time Zone dropdown lists respectively.
3. Additional Encryption Properties: For detailed information on Encryption Properties, refer to the Select a File Steps 2b to 2h.

You can also create more Datasets from Salesforce, MDA data and Amazon S3 and perform Merge, Transform and other actions on the created Datasets. Then, you can proceed to the Explore tab to analyze the data and create reports.