« Minimal Reproducible »
Home Tags About GitHub

Posts with tag ardc

lerobot be like

2025-03-04
0325ardcjulyfunnotes

lerobot be like observation.state action episode_index frame_index timestamp next.done index task_index 0 [0.0, -0.96, 1.16, 0.0, -0.3, 0.0, 0.0, 0.0, -... [0.009203885, -0.9341943, 1.1734953, -0.004601... 0 0 0.00 False 0 0 1 [0.0007582012, -0.9566894, 1.1651634, -0.00142... [0.009203885, -0.9341943, 1.1734953, -0.003067... 0 1 0.02 False 1 0 2 [0.0018032654, -0.9522623, 1.1714675, -0.00530... [0.0076699043, -0.93266034, 1.1734953, -0.0046... 0 2 0.04 False 2 0 3 [0.0026358203, -0.9482949, 1.1752888, -0.00741... [0.009203885, -0.93266034, 1.1750293, -0.00460... 0 3 0.06 False 3 0 4 [0.0034279125, -0.9450332, 1.177441, -0.008036... [0.009203885, -0.93266034, 1.1750293, -0.00460... 0 4 0.08 False 4 0 .. ... ... ... ... ... ... ... ... 195 [0.006011534, -0.11404947, 0.83533436, -0.0294... [-0.009203885, -0.11811652, 0.8360196, -0.0276... 0 195 3.90 False 195 0 196 [0.0040293564, -0.114590585, 0.83659065, -0.02... [-0.009203885, -0.11811652, 0.8360196, -0.0291... 0 196 3.92 False 196 0 197 [0.0023085629, -0.11500274, 0.83785635, -0.030... [-0.009203885, -0.11811652, 0.83755356, -0.029... 0 197 3.94 False 197 0 198 [0.00080802303, -0.115325116, 0.8390446, -0.03... [-0.009203885, -0.11811652, 0.8390875, -0.0306... 0 198 3.96 False 198 0 199 [-0.0004944365, -0.115580015, 0.84037006, -0.0... [-0.009203885, -0.11811652, 0.8406215, -0.0306... 0 199 3.98 False 199 0 `

what-features-should-it-have-f-9s5soB3SSkiy05QCbJ5Frw

2025-03-04
0325ardcjulyfunnotes

To design an API for efficiently uploading large dataset files from mobile devices to a PC server, the following features are essential based on industry best practices and technical requirements:Core Features1. Resumable UploadsAllow uploads to pause and resume automatically after network interruptions, avoiding restarts. Critical for mobile environments with unstable connections[1][4].Implement session tracking (e.g., unique upload IDs) to manage interrupted transfers[1][7].2. Chunked File TransferSplit large files into smaller chunks (e.g., 100 MB each) to:Reduce memory strain on servers and clients[1][2].Enable retries of failed chunks without resending the entire file[5].Use multipart/form-data encoding for efficient chunk assembly[2][5].3. Streaming SupportProcess files as they are uploaded (client-to-server streaming) to avoid buffering entire datasets in memory[1][2].Example: Use Node.js createReadStream or .NET Request.Body streaming[1][2].4. Cloud Storage IntegrationDirectly upload files to cloud storage (e.g., AWS S3, Azure Blob) via pre-signed URLs to offload server processing[5][8].Reduce API latency by separating file uploads from metadata handling[3][8].5. CDN and Geographic OptimizationRoute uploads to the nearest CDN edge location (e.g., AWS Transfer Acceleration) to minimize latency[1][4].Ensure global users experience consistent speeds[1][4].Performance and Reliability6. Error Handling and LoggingImplement robust error logging to diagnose failures (e.g., network timeouts, corrupted chunks)[2][5].Validate checksums (e.g., MD5, SHA-256) for data integrity[1][5].7. Rate Limiting and ThrottlingPrevent server overload by limiting concurrent uploads or bandwidth per client[2][5].Use asynchronous processing for heavy workloads (e.g., Hangfire)[2].8. Timeout ManagementAdjust server and client timeouts to accommodate large transfers[2][5].Use keep-alive signals to maintain active sessions[7].Security9. Secure TransfersEnforce HTTPS for encrypted data transmission[1][4].Use token-based authentication (e.g., OAuth 2.0) to control access[4][8].10. Access ControlsRestrict upload permissions via roles (e.g., admin, user)[1][4].Validate file types and sizes to prevent malicious uploads[8].User Experience11. Progress TrackingProvide real-time upload progress (e.g., percentage completed) to users[4][5].Send email/SMS notifications on success or failure[4].12. Client-Side SDKsOffer mobile SDKs (iOS/Android) to simplify integration:Automatic chunking and retries[1][4].Network optimization (e.g., Wi-Fi vs. cellular)[5].13. CompressionEnable optional on-device compression (e.g., ZIP) to reduce transfer sizes[5].Scalability14. Load BalancingDistribute upload requests across multiple servers to handle high traffic[1][8].Use auto-scaling to adjust capacity dynamically[4].15. Metadata SupportAttach custom metadata (e.g., timestamps, device info) to files during upload[8].By combining these features, the API will ensure fast, reliable, and secure large file transfers from mobile devices, even in low-bandwidth environments. Solutions like Uploadcare[1] or TransferNow[4] provide prebuilt infrastructure, while custom implementations can leverage AWS S3, resumable protocols[7], and client SDKs for optimal performance.Citations: [1] https://uploadcare.com/blog/handling-large-file-uploads/ [2] https://learn.microsoft.com/en-us/answers/questions/1375143/strategies-for-handling-large-file-uploads-in-a-ne [3] https://intelligentpathways.com.au/enabling-large-file-transfer-with-apis/ [4] https://developers.transfernow.net [5] https://www.reddit.com/r/softwarearchitecture/comments/10v7mo2/how_to_upload_large_files_1gb_through_a_restapi/ [6] https://stackoverflow.com/questions/2276851/large-data-transfer-between-mobile-app-and-a-server/2276888 [7] https://developers.google.com/android-publisher/upload [8] https://terem.tech/api-file-upload-best-practice/ [9] https://blog.xapihub.io/2023/12/22/Handling-File-Uploads-in-RESTful-APIs.html [10] https://apidog.com/blog/file-upload-in-apis/ [11] https://stackoverflow.com/questions/33889410/proper-way-to-implement-restful-large-file-upload [12] https://stackoverflow.com/questions/26535866/best-approach-to-send-big-files-to-a-server-in-a-automatic-way-using-a-rest-api [13] https://stackoverflow.com/questions/3351742/upload-large-files-on-the-web-server-on-android [14] https://softwareengineering.stackexchange.com/questions/272035/best-practice-for-uploading-large-file-previewing-and-editing-before-saving-to [15] https://blog.stoplight.io/best-practices-for-designing-apis-for-mobile-apps [16] https://www.dropboxforum.com/discussions/101000042/an-actually-useful-guide-on-uploading-large-files-via-api/555797 [17] https://terem.tech/large-files-apis-lessons-learnt/ [18] https://developers.google.com/drive/api/guides/manage-uploads [19] https://community.openai.com/t/uploading-large-files/14857 [20] https://github.com/immich-app/immich/discussions/1674来自 Perplexity 的回答: pplx.ai/shar

No more posts to load.