Moving servers today

This section will contain posting guidelines for the forum along with any other information that is relevant to this forum.
User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Moving servers today

Post by neptronix » Aug 03 2021 3:52pm

Hey all. Just a heads up. I'm going to be moving the server today. There will be a 30min - 1 hr total downtime.
You may experience some slow performance while files crunch along in preparation for the move.

The good news is that we'll be on amazon and have longer backups ( something that was previously very expensive ) and also eliminate the intermittent stuttering issue that our current host has ( digitalocean ).

I will announce the downtime in advance, but it will probably be in a few hours.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 03 2021 6:06pm

Prep work done.
The server will go down in approximately an hour and i expect it to be down for approx 45 mins due to the large amount of files that need to be moved.

Hang in there and sorry for the interruption.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 03 2021 7:11pm

Okie, time to pull the plug. See you in about an hour.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 03 2021 10:00pm

Well that was a pain in the ass and took way longer than i expected.
Ok, this 6 hour job is done...... now you know why i've been putting it off :lol:

Do let me know if you notice anything... off as a result of this change.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 03 2021 10:01pm

Are images are still being uncompressed from the backup and it will be another 1-2 hours until missing images re-appear.
Edit: time expectation
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 03 2021 10:16pm

Wow that happened a lot quicker than i expected.
Images are back and everything seems to work.

Performance may be pokey until tomorrow. OK, i'm done for the day!
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

markz   100 GW

100 GW
Posts: 11947
Joined: Jan 09 2014 11:38pm

Re: Moving servers today

Post by markz » Aug 03 2021 10:27pm

Thanks for your work Neptronix
:thumb:

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 03 2021 11:00pm

You're welcome :)
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
nicobie   1 GW

1 GW
Posts: 3244
Joined: Aug 07 2008 1:48pm
Location: Central Coast CA, USA

Re: Moving servers today

Post by nicobie » Aug 04 2021 1:47pm

Everything seems to be working fine for me.

Thank you for the time spent keeping the forum chugging along.

Next event will hopefully be the new forum software (when you can spare the time). 👍
Ask for it by name.

my eTownie build thread: http://endless-sphere.com/forums/viewto ... =6&t=23701
Magazine article https://www.electricbike.com/nicks-etownie/

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 04 2021 3:55pm

Glad nobody is seeing issues!
You're welcome also, It's always a little hair raising for me to take down my favorite internet community. So happy that's over.

This server move is actually a big thing. We now have to ability to spawn multiple development environments from a rolling virtual machine image of the server itself. Meaning that more than 1 person can work on ES at a time.

The duration of backups we can keep is also up from 2 days to 1 year. Super good.

A big barrier was removed to getting the Xenforo environment working. The main barrier to deployment is that on a 2 core server like we have, the translation from phpbb to xenforo takes about 12 hours. Then for the data transformation processes, you're looking at 5 hours on top of that. So it becomes a 17 hour job.

Using a local 8-16 core virtual machine copy of the server would be gazillions of times faster, esp if you had a fast SSD.
My idea for this process would be to get the downtime down to 6 hours.
It is now possible :)
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
Greendog   10 W

10 W
Posts: 98
Joined: Jun 15 2021 5:27pm

Re: Moving servers today

Post by Greendog » Aug 04 2021 4:01pm

Computers :roll: always seems take bit longer than expect, cheers for your work :thumb: :bolt:
“If you want to find the secrets of the universe, think in terms of energy, frequency and vibration.”

my ride , viewtopic.php?f=6&t=112483.
olive, camo bike
viewtopic.php?f=6&t=112696
kona commuter viewtopic.php?f=6&t=235&start=2000#p1675516A clever man solves problems a wise one avoids them
“It is true that whisky improves with age. The older I get, the more I like it.” :wink:

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 04 2021 4:23pm

Server tweaking is done. Performance should be a bit snappier.

There will be a reboot in about an hour and images may temporarily go missing, but will be restored.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 04 2021 6:22pm

Server needs a reboot and a beating on the command line.
Will be down for 5-10 mins.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 04 2021 6:28pm

That was quicker than expected.

Stored images are going to disappear temporarily while i move 50g of data from one disk to another. Hang in there, this is the last of the surgery.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
ZeroEm   1 MW

1 MW
Posts: 1799
Joined: May 03 2019 11:53am
Location: San Antonio, TX

Re: Moving servers today

Post by ZeroEm » Aug 04 2021 6:48pm

Looks good from San Antonio, TX.

Thank you for all your hard work neptronix! :bigthumb:
2019 Performer E-Trike
2013 Nissan Leaf S 7 bars 331.5w/KM

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Aug 04 2021 7:06pm

Thank you.

Images should all be back, and surgery is finally done, phew!!! :es:
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
kauaicycler   100 W

100 W
Posts: 157
Joined: May 18 2019 1:37pm
Location: Cocoa, FL
Contact:

Re: Moving servers today

Post by kauaicycler » Aug 05 2021 11:38am

Server moves are scary, I've been through a few, the worst one also involved switching from Solaris to Linux. I'm a big fan of virtual machines. I'm very familiar with Vagrant and Virtual Box for dev machines. Let me know if I can help, the one day I don't check the forum and you move the server. I'm glad everything went relatively smooth.
Build Thread: Meet Miss Mino'aka (Hawaiian for smile) Electra Lux 7D Fat Tire with a BBSHD

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Sep 13 2021 4:05pm

Just an update on this.

We've been closer to the edge of a 4gb memory limit on AWS than we were on digitalocean; probably because of the software AWS installs on all the OSes they provide.

Mysql is crashing and restarting on a daily basis because it can occasionally creep over this limit..

I'm aware of this and am looking for small memory cuts to prevent us from having to double our hosting costs over this.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Sep 14 2021 5:59pm

I believe i have curred the hiccup. Let me know if you see the forum stutter. Has looked very stable from here.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

Redsea Rider   10 mW

10 mW
Posts: 21
Joined: Jul 17 2020 7:06pm
Contact:

Re: Moving servers today

Post by Redsea Rider » Sep 16 2021 8:18am

Amascam
The entire cloud is designed to confuse you into paying more.
They intimidate you by constantly adding redundant services that you don't need but don't have
the time to read white papers on. You either give in or you're "too basic to understand"

Its just a money making scheme.
They will spin up so many sub service services...
you'll spend a day with tech support unspinning things
next month your still being billed
another day with tech support - "You didn't see the link on the page with a thousand links"
lol - I'm pretty pretty sure that link is intended to NOT be seen.

they moved on the US government - imagine the billing!?!
Jeff triple lindseys into his pool of gold coins and comes up for air with a splash of sparkly gold -
"Great isn't it?" guffaws

GET OUT its never too late.
Massawa
N.A and E.U Director
Business Development
sales@fardriver.io

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Sep 16 2021 1:43pm

I understand why you think AWS is a huge pain in the ass. I got thrown into the role of being a AWS server administrator in 2014, and had to learn how to work AWS the hard way. The learning curve is mondo.

But.. knowing how to twiddle these knobs, some setups i'm responsible for *are* cheaper on AWS than anywhere else. And when costs matter, sometimes AWS is the right choice.

I'd prefer to not give amazon a dime. But it makes sense here.
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

markz   100 GW

100 GW
Posts: 11947
Joined: Jan 09 2014 11:38pm

Re: Moving servers today

Post by markz » Sep 17 2021 2:22am

So the attachments for pictures limit is 36 as of yesterday when I saw the warning editing a post.
Its plenty, sometimes I just leave blurry pictures in because I am to lazy to delete them. But yeah it makes you think more of what to attach for pictures then minor things.

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Sep 17 2021 1:50pm

That's why systems like phpbb and xenforo are designed to put limits in at the stage of uploading.
Which can be inconvenient to the user.

That's why i put ~100 hours into writing a platform agnostic, after-the-fact image processor just for our form.

But if a picture is 1000 words then 36 pictures is a novel. See if you can tell the story with less words. :)
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

User avatar
ZeroEm   1 MW

1 MW
Posts: 1799
Joined: May 03 2019 11:53am
Location: San Antonio, TX

Re: Moving servers today

Post by ZeroEm » Sep 17 2021 5:17pm

I'm from the by gone days when pics would have been limited in number much less size. I think the requirements are pretty lax. It's not really the 36 pictures it's the 36 large pictures. If people would size them no larger than needed. Any way good job.
by neptronix » Sep 17 2021 1:50pm

That's why systems like phpbb and xenforo are designed to put limits in at the stage of uploading.
Which can be inconvenient to the user.

That's why i put ~100 hours into writing a platform agnostic, after-the-fact image processor just for our form.

But if a picture is 1000 words then 36 pictures is a novel. See if you can tell the story with less words. :)
2019 Performer E-Trike
2013 Nissan Leaf S 7 bars 331.5w/KM

User avatar
neptronix   100 GW

100 GW
Posts: 15825
Joined: Jun 15 2010 5:56pm
Location: Utah, USA
Contact:

Re: Moving servers today

Post by neptronix » Sep 17 2021 7:54pm

They all get forced into being below 2048 x 1500 size. So you can upload whatever the hell you want!
Idea stolen from facebook. :)
"Love and compassion are necessities, not luxuries. Without them, humanity cannot survive." - Dalai Lama

My first major build: 1.6kW 8T MAC motor on a Trek 4500 MTB.
Monster MTB: Leafmotor 1500w @ 4kW on a Turner O2 full suspension.
The monster scooter: Heavy duty Cannondale semi recumbent - under construction.
Blue Dream: Maxaraya FS semi recumbent and high efficiency mid-drive - under construction.

Post Reply