OpenSimWorld is the directory of 3D Virtual Worlds based on OpenSimulator and connected through the HyperGrid. Learn More
New Members
Thorvaldr_Ragnasson, Ok9vin, Nhacaiuytinco1, Princecatrin, 19441962, Flokieig, Ella, 789clubitcom, Patersonlawrence, Alesia, DiamondJack, Sacha, Hazeplays, SeverusCarlisle, SATIN, Naihomy Smith, ScottyRobotic, LaramieWinslow, Sethsoules, ClaudiorauLikes
Data transfer status.
Do you remember a post I made some time ago, about assets missing due a day transfer?
Let me tell you the full story because I got a post that's a bit too angry and a bit too misinformed for my taste.
Originally OSG was mostly on a datacentre on Texas, at first it was good, but it got progressively more and more inadequate for the grid, do you remember two years ago that we had a weekly outage? Or sudden grid downs that used to last 24 hours?
It was time to move the whole grid to new pastures and they did! The total data was transferred to a better datacetre, the transference was brutal though, we're talking about millions upon millions of tiny files, it took months to transfer all that and they managed to do it with the grid running. Of course there was side effects, slowness to rez, extended times to see the textures appear, etc. A small price to pay compared to the alternative: shut down the grid for a couple of months.
Some days ago I was told the current status of the last server move, the one with oldest assets, most notably 1+ year old textures and notecards.
The good news: the transfer is done, it took about a month.
I was told not once, not twice but several times: No data was lost.
"So where are my textures?"
This is the current situation: While the data is already transferred it's the equivalent of moving, we have all the boxes into the new house, now it's time to unbox and arrange our stuff in the empty space.
That last server had about 168 million assets.
The program that the guys wrote specifically to ingest the data into the new server process about 1.6 million assets per day, plus they're verifying the integrity of each bit (thanks to that they had corrected/recover 4854 assets so far), the whole process assuming 1.3 million assets processed and ingested per day will take between 90 to 120 days from today.
I asked if this will cause lag or poor performance: No, this process happens on a separate server, and it's independent of the rest of the grid, so it won't impact performance.
No data has been lost, but many is still in the box, waiting to be put in the proper place.
Is it a bummer? of course it is, all my profile pictures (all of them are 1+ year old) are gone, white. I won't delete them because they will be back.
Finally this process is progressive, it means that as the data gets processed it becomes available, my pic today is white but tomorrow may be back, as it reaches its's turn in the queue.
So don't despair, we're in the final stretch.
Do you remember a post I made some time ago, about assets missing due a day transfer?
Let me tell you the full story because I got a post that's a bit too angry and a bit too misinformed for my taste.
Originally OSG was mostly on a datacentre on Texas, at first it was good, but it got progressively more and more inadequate for the grid, do you remember two years ago that we had a weekly outage? Or sudden grid downs that used to last 24 hours?
It was time to move the whole grid to new pastures and they did! The total data was transferred to a better datacetre, the transference was brutal though, we're talking about millions upon millions of tiny files, it took months to transfer all that and they managed to do it with the grid running. Of course there was side effects, slowness to rez, extended times to see the textures appear, etc. A small price to pay compared to the alternative: shut down the grid for a couple of months.
Some days ago I was told the current status of the last server move, the one with oldest assets, most notably 1+ year old textures and notecards.
The good news: the transfer is done, it took about a month.
I was told not once, not twice but several times: No data was lost.
"So where are my textures?"
This is the current situation: While the data is already transferred it's the equivalent of moving, we have all the boxes into the new house, now it's time to unbox and arrange our stuff in the empty space.
That last server had about 168 million assets.
The program that the guys wrote specifically to ingest the data into the new server process about 1.6 million assets per day, plus they're verifying the integrity of each bit (thanks to that they had corrected/recover 4854 assets so far), the whole process assuming 1.3 million assets processed and ingested per day will take between 90 to 120 days from today.
I asked if this will cause lag or poor performance: No, this process happens on a separate server, and it's independent of the rest of the grid, so it won't impact performance.
No data has been lost, but many is still in the box, waiting to be put in the proper place.
Is it a bummer? of course it is, all my profile pictures (all of them are 1+ year old) are gone, white. I won't delete them because they will be back.
Finally this process is progressive, it means that as the data gets processed it becomes available, my pic today is white but tomorrow may be back, as it reaches its's turn in the queue.
So don't despair, we're in the final stretch.
Liked by: 
Comments
Addendum:
Sadly I don't have great news to communicate. It seems I misunderstood what I've been told before, so I need to clarify a couple of things.
First of all the affected assets: It turns out it's not only textures and notecards but basically all assets, so prims, meshes etc are affected too.
Secondly the time the affected assets are not a year old but 6 months old, so whatever is about 6 months or older may be missing for now.
That being said the rest is accurate: no assets were lost during the transfer and the ingestion of the new assets is on going, if you miss any don't worry it will come back. However I asked about what if you want your object back now, the answer was either re-load it from a backup (IAR, OAR), or get it from where you got it before. Otherwise it's a matter of patience and don't panic, the object is there, just unavailable for about 4 months.
That being said let me repeat something: while your asset may be missing now, it may come back tomorrow as assets that have been processed are immediately available again. This is sheer luck however.
I hope next time I'll be able to tell you good news. For now and for the future the best course of action is to have a storage sim where you can offload (rez) the objects that matters the most to you and save them as OAR. Remember that the affected objects are the ones in the inventory, not rezzed on a sim.
I'm sorry I misunderstood things, this time I double checked to be as accurate as possible.
like(3)
Sadly I don't have great news to communicate. It seems I misunderstood what I've been told before, so I need to clarify a couple of things.
First of all the affected assets: It turns out it's not only textures and notecards but basically all assets, so prims, meshes etc are affected too.
Secondly the time the affected assets are not a year old but 6 months old, so whatever is about 6 months or older may be missing for now.
That being said the rest is accurate: no assets were lost during the transfer and the ingestion of the new assets is on going, if you miss any don't worry it will come back. However I asked about what if you want your object back now, the answer was either re-load it from a backup (IAR, OAR), or get it from where you got it before. Otherwise it's a matter of patience and don't panic, the object is there, just unavailable for about 4 months.
That being said let me repeat something: while your asset may be missing now, it may come back tomorrow as assets that have been processed are immediately available again. This is sheer luck however.
I hope next time I'll be able to tell you good news. For now and for the future the best course of action is to have a storage sim where you can offload (rez) the objects that matters the most to you and save them as OAR. Remember that the affected objects are the ones in the inventory, not rezzed on a sim.
I'm sorry I misunderstood things, this time I double checked to be as accurate as possible.
Thanks for this Aaack, all I can say is patience is a virtue! :) I donated to OSgrid recently via the sl location so I hope it goes through.I have land in sl that a friend rents from me and now have a backlog of lindens, Id like to donate more but want to make sure that it works. Is there a way to confirm that it is?
like(2)
Of course you can to new items when you download new texture you check that fullperms and export is ticked
like(1)
ye but atm we do have that asset issue in many grids not only in Osgrid and it would be good to have information how it is done so people would not have broken links and asset not founds.. asset mainly is UIID. People which gets items from HG have no clue do they get the asset it will be figured out when they try to get it from their inventory and see that asset not found whine.
like(0)