Feature - CakePHP upgrade (massive, complex and uncertain)

for those of you that are lucky and dont deal with software development (stay that way, is a lot healthier) this post might sound like a trivial update, but is actually not.

we need to upgrade our CakePHP framework from 2.x to 4.x in the coming months, Cake is basically the “heart” of eramba and affects anything you do on the application. this is necessary to make sure eramba uses the latest technology, otherwise we become another prehistoric grc solution that is impossible to maintain.

Its forecasted to take %100 of our development manpower (sounds like a lot right? it isn’t) for three full months. during that time we wont be able to make any new feature, just (hopefully) small bug fixes. our guess is we’ll start in May 2020 and finish during the summer. anyway it doesnt look like we’ll be able to go anywhere for holidays at least here in europe.

Good news is after this eramba should work better, probably faster too. We’ll be able to focus on workflows and other features we would like to do this year. The bad news is we never did this before so we are not entirely sure how to do it or release it to thousands of people :slight_smile:

int ref: https://github.com/eramba/eramba_v2/issues/2552

2 Likes

well, a bit of an update … we wont be over until end of October as usual it took longer than expected or planned. we have been working on this full time and still lost some grip on it due bug fixes, etc …

guess what? its december and we have not finished :slight_smile:

maybe end of the year…

very promising preliminary results in terms of performance (speed of use) on the new migrated cake … it could go 40-60 times quicker apparently !

Awesome! This is great news! Should we expect the upgrade around early 2021? :slight_smile:

We completed the core code, we are migrating section by section now - the plan is here: https://docs.google.com/spreadsheets/d/1nDnHZyXaTlahaUByO_8rWY9I3gyFrLdZpTDY7qh7zGc/edit?usp=sharing

apparently, we’ll finish before march … but we’ll see is pretty complex !!

1 Like

We are testing and preparing how the migration will be to eramba_v3 (not v2), a few things you will need to prepare at the time of the migration (not now):

  • you will install the upgrade with a package using linux cli
  • you will run the package using your current version of php
  • after the migration completes you will need to upgrade your php to 7.4.x or 8.x (better)

We are hoping to contact customers during first weeks of April, we’ll try to help everyone over zoom with the migration

This still on track? We are heavily using Eramba and the biggest complaint is how slow it operates. can’t wait for 400x faster! Great work.

every day … most weekends … hopefully during april we finish this stuff

it wont be 400x faster tough … more like 0.6x faster … we’ll see :slight_smile:

It needs to be way faster as its a bit of a dog on some queries.

Even 40-60 x would be awesome!

Its June now - any ETA on when the v3 update will release?

1 Like

Hello James, yes we are not very good at deadlines, we finished online (also offline) update process so we are really close to release. We just need to test it carefully. Here is small preview of update process.
image
and also offline process
image

2 Likes

Speed / Load testing on a fat db shows as you can see a faster system, vertical axe is seconds , horizontal sections

i had to strip the vertical axe to 50, some section took a lot longer than 50 seconds when fully loaded (first admin login, online assessments, etc)

in average, 3.x loads any section in 4.2 seconds while 2.x used to do the same db in 14.5 seconds…in average, it seems 3.x is 3-4 times faster. we believe it could go faster (3.x is not using caching yet) but as it stands now we are quite happy. the important is now if a section has many thousands of items, loading times wont be exponentially affected (as it would have happened in 2.x) … loading times even with many thousands of items should remain around 4-7seconds. in the past it took thousands of queries to load a section, in average now is 100-150 queries no matter the amount of items.

next tuesday we finish the migration, we will need the rest of the week for bug fixing…maybe the week after we’ll start communicating customers to upgrade to 3.x

2 Likes

That’s cool, eagerly waiting for the update. Hopefully we get it soon.

We will start migrating customers over calls, the first batch of customers will be mailed this week and we’ll based on that migrate further customers. Is likely that all new (fresh) installs in August will use 3.x alone

We run different scans and most seems ok , just boostrap version and the cookie thing:

we migrated 5 customers (our of 350) and we are working on migrating a few others this week working around some issues. In a week or two from now we’ll release an upgrade guide with videos, etc for everyone.

We have completed the migration for most our customers, so this project is complete. It just took nearly two years (our original estimation was 6-9 months).