Plugins

• The bundling process for plugins has been optimized, resolving any previous issues and ensuring a smooth integration experience.
• Dependencies have been updated, including the @flatfile/plugin-record-hook package, which is now at version 1.5.2, ensuring compatibility with the latest releases.

npm install @flatfile/plugin-constraints@1.2.1

• Dual Functionality: The newly released GraphQL to Flatfile Blueprint plugin offers versatile integration options for your Flatfile workspace. Use it to either generate a Flatfile Blueprint directly from GraphQL or configure a Flatfile Space using GraphQL, streamlining your data integration processes.
• Flexible Input Sources: The plugin supports multiple methods for supplying GraphQL data:
• API Endpoint: Connect directly to a GraphQL API to fetch data.
• Schema File: Upload a GraphQL schema file.
• Custom Callback: Implement a custom callback function for advanced data handling and customization.

• Improved Error Handling: This release enhances the error management capabilities of the plugin, ensuring more robust and informative error responses during data extraction processes.
• Accurate File Status Updates: Upon successful job completion, the file status is now correctly updated, providing clear visibility and tracking of job outcomes.
• Enhanced Database Availability Checks: Recognizing the potential delays in database readiness, the plugin now includes polling mechanisms for database users. This ensures that operations proceed only when the restored database is fully available, enhancing the reliability of data interactions.

listener.use(
  configureSpaceWithYamlSchema([{ sourceUrl: "https://example.com/yaml" }]),
);

• options.workbookConfig: The options.workbookConfig parameter allows you to incorporate other optional Workbook configurations seamlessly.
• options.debug: Toggle the options.debug parameter on/off to access helpful debugging messages for development purposes.
• callback: The callback parameter, which receives three arguments—event, workbookIds, and a tick function—empowers you with the ability to update the Job’s progress. Note: This callback function is invoked once the Space and Workbooks are fully configured.

listener.use(
  configureSpaceWithJsonSchema([
    { sourceUrl: "https://example.com/customer.schema.json" },
  ]),
);

• options.workbookConfig: The options.workbookConfig parameter allows you to incorporate other optional Workbook configurations seamlessly.
• options.debug: Toggle the options.debug parameter on/off to access helpful debugging messages for development purposes.
• callback: The callback parameter, which receives three arguments—event, workbookIds, and a tick function—empowers you with the ability to update the Job’s progress. Note: This callback function is invoked once the Space and Workbooks are fully configured.

• Previously, an issue arose when attempting to complete a commit with the trackChanges flag (a Workbook setting to disable actions on Sheet and Workbook when there is a commit that has not been completed) disabled on the Workbook. This issue has been resolved, and commits are now exclusively triggered when the trackChanges feature is enabled for the Workbook.
• Additionally, we’ve implemented an advanced deep comparison method between the original record and the potentially modified record. This enhancement guarantees that only essential patches for updated records are transmitted, resulting in a notably more efficient and precise data update process.

• @flatfile/plugin-xlsx-extractor@1.7.5
• @flatfile/plugin-delimiter-extractor@0.7.3
• @flatfile/plugin-json-extractor@0.6.4
• @flatfile/plugin-pdf-extractor@0.0.5
• @flatfile/plugin-xml-extractor@0.5.4
• @flatfile/plugin-zip-extractor@0.3.7

1. Takes a RejectionResponse containing rejected Records and a rejection message.
2. Locates the corresponding Record and adds the rejection message as an error to the Record cell.

• Numbers: String numbers (‘1’), string decimals (‘1.1’), and string numbers with commas (‘1,000’) are interpreted as numbers.
• Booleans:
  • Truthy values: ‘1’, ‘yes’, ‘true’, ‘on’, ’ ’, ‘y’, and 1.
  • Falsy values: ’- ’, ‘0’, ‘no’, ‘false’, ‘off’, ’ ’, ‘n’, 0, -1.
• Dates: Date strings and numbers are cast to a UTC string (note: YYYY-MM-DD... is interpreted as an ISO 8601 date and is treated as treated as UTC, while other formats are treated as local time and converted to UTC).
  • ‘2023-08-16’ => ‘Wed, 16 Aug 2023 00:00:00 GMT’
  • ‘08-16-2023’ => ‘Wed, 16 Aug 2023 00:00:00 GMT’
  • ‘08/16/2023’ => ‘Wed, 16 Aug 2023 00:00:00 GMT’
  • ‘Aug 16, 2023’ => ‘Wed, 16 Aug 2023 00:00:00 GMT’
  • ‘August 16, 2023’ => ‘Wed, 16 Aug 2023 00:00:00 GMT’
  • ‘2023-08-16T00:00:00.000Z’ => ‘Wed, 16 Aug 2023 00:00:00 GMT’
  • 1692144000000 => ‘Wed, 16 Aug 2023 00:00:00 GMT’

• Update Job progress using await tick(progress, message), returning a promise for JobResponse.
• opts.debug Enable debug logging for the plugin

• The setup parameter holds the Blueprint for the new Space.
• And the callback parameter (invoked once the Space and Workbooks are fully configured) receives three arguments:

1. event
2. workbookIds
3. Using the @flatfile/plugin-jobs-handler under the hood, the tick function can be used to update the Job’s progress.

• chunkSize: (Default: 3,000) Define how many records you want to process in each batch. This allows you to balance efficiency and resource utilization based on your specific use case.
• parallel: (Default: 1) Choose whether the records should be processed in parallel. This enables you to optimize the execution time when dealing with large datasets.

listener.use(ExcelExtractor({ chunkSize: 300, parallel: 2 }));

• Advanced Algorithm: When extractors do not receive explicit mapping guidance, they leverage a sophisticated algorithm to discern the optimal headers from your data. This is achieved by examining the first 10 rows and selecting the row with the most non-empty cells as the header.
• Traditional Header Parsing: Files where the first row serves as the header will continue to function seamlessly. However, extractors can now handle scenarios where headers might be in a different row, providing greater flexibility.
• Precision and Efficiency: This capability ensures that even files with unconventional structures can be accurately processed, reducing manual intervention and enhancing user experience.
• Works with Your Existing Setup: This is not a breaking change. Existing implementations will continue to work as before.

​

Affected Plugins:

• @flatfile/plugin-xlsx-extractor
• @flatfile/plugin-delimiter-extractor
• @flatfile/plugin-json-extractor

​

Benefits:

• Smarter Data Processing: Automatically detects optimal headers, improving data accuracy.
• Enhanced User Experience: Reduces the need for manual adjustments in file structure.
• Increased Flexibility: Handles files with non-standard header placements.