Frequently Asked Questions for Data Processing Tools

Bulk Data Processing Speed

• FAQ: Is bulk data processing faster than standard data import? Can speed be further improved with a dedicated database?

• Answer: Yes, bulk data processing is typically faster than standard data import. In public cloud environments, bulk processing has speed limitations, but these can be mitigated by configuring a dedicated database and manually adjusting thresholds. Standard data import processes approximately 50 records per second, whereas bulk processing is significantly faster.

File Size Limits for Import

• FAQ: What are the maximum file sizes supported by standard import and bulk data processing?

• Answer: Standard import file size limits vary based on workflow and approval triggers:

  • No workflow or approval triggered: Up to 300,000 records, max 50MB.

  • Workflow triggered (no approval): Up to 1,000 records, max 2MB.

  • Both workflow and approval triggered: Up to 500 records, max 2MB.

• Bulk data processing supports files up to 100MB.

Functional Permission Control

• FAQ: Can bulk data processing restrict import/export/delete buttons via functional permissions? Can backend objects be integrated into the permission system to differentiate Roles and assign button-level access?

• Answer: Currently, bulk data processing does not support button-level permission control. However, this feature is planned for future releases, enabling Role-based button permission assignments.

File Server Integration

• FAQ: Can bulk data processing integrate with file servers (e.g., allowing sales reps to upload files to designated locations and schedule automated file parsing)?

• Answer: The current import feature does not support direct file server integration. For scenarios requiring scheduled file uploads to Cloud Drive, we recommend evaluating operational necessity (e.g., error handling workflows). Export functionality supports integration with Alibaba Cloud or locally hosted FTP services.

Import/Export Speed Optimization

• FAQ: Can standard import/export speeds be optimized? Even after optimization, will there still be a significant gap compared to bulk processing?

• Answer: Short-term optimization of standard import/export speeds is not feasible. Even with optimizations, workflows and approvals require complex validation logic, limiting speed improvements. Bulk processing avoids these triggers, maintaining a clear speed advantage.