Damus
The Fishcake🐶🐾
Recent notes
I did fix it before going to sleep, so at least backup works if R2 fails. Meanwhile at Cloudflare trust and safety department yesterday. https://image.nostr.build/70ae4b81588a7344e53be3abe406b03667b0ab7b7259259c327b6670f68465aa.jpg note1dm6a2kkt5tma53yelzweq0nxsdjgre9luelsff60styfsv8h539qraw7du
Final update for today. Well, seems that the backup upload was not executed when the primary upload failed, resulting in an orphan link and failed upload. As they say, always verify your backup code in realistic scenarios, and we failed to do so. As a result I had to delete 88 free upload entries from the database, and 8 from the account ones. Lessons learned, always test that your backup works when your primary is in failed state. This only affected uploads approximately between 2025/02/06 08:13 and 2025/02/06 10:30 UTC. I will be fixing and testing the code with failure scenarios to ensure that when we return OK for upload, we at least have it in the backup. Apologies for any inconvenience or problems caused by this event, we will do better next time. 🫡🙇♂️🙇♂️🙇♂️ note1uutfauefveanf47sf8vzkl95jtlzz87sq6r65wl5mccnua42xz8selcew6
While all services returned to normal, we have a few 404 pictures that I’ll restore and recover from our backup storage (yes, we upload to two separate object storage providers). This may take me a little bit of time and effort, so please forgive for delay! 🙇♂️🙏🏻 note1fg443vqkddcs566fjuye7kpnvrjdrwnfwa6zmdjhuhmk38m89qes8433rs