Clients page empty(other pages work)

russworkalot

As title states the clients page is blank and I cannot click on anything from the clients page, i.e. username, etc.

other pages work, tickets, quotes, dashboard, etc. it seems only issue is with clients page. If I create a new tickets clients show up in list but nothing on itflow.company.com/clients.php page.

I can get to the admin page only using url directly itflow.company.com/admin_update.php. All updates have been applied. check timezone issue as well.

Current Database Version:

1.4.5

wrongecho

Did you install MariaDB or MySQL?

russworkalot

Server Info

PHP version: 8.1.2-1ubuntu2.18
Database Version: 5.5.5-10.6.18-MariaDB-0ubuntu0.22.04.1 / 100618
Operating System: Linux itflow 5.15.0-119-generic #129-Ubuntu SMP Fri Aug 2 19:25:20 UTC 2024 x86_64
Web Server: Apache/2.4.58 (Ubuntu)

Let me know if this doesn't answer your question.

wrongecho

We usually see this issue with MySQL, which was why I asked.

Could you please link the install doc you followed (script vs manual)?

Upon loading the clients page, what error logs are generated in /var/log/apache2/error.log ?

russworkalot

This was setup 6-8 months ago and has been fine until now. I used the standard install script back then.

[Thu Sep 05 12:40:51.839511 2024] [php:error] [pid 1552] [client 1.1.1.1:44786] PHP Fatal error: Uncaught mysqli_sql_exception: Table 'itflow.u ser_roles' doesn't exist in /var/www/itflow.company.com/admin_users.php:20\nStack trace:\n#0 /var/www/itflow.company.com/admin_users.php(20): mysql i_query()\n#1 {main}\n thrown in /var/www/itflow.company.com/admin_users.php on line 20, referer: https://itflow.company.com/admin_users.php

[Thu Sep 05 12:40:52.720234 2024] [php:notice] [pid 1552] [client 1.1.1.1:44786] MySQL error: Table 'itflow.user_permissions' doesn't exist, ref erer: https://itflow.company.com/admin_users.php

[Thu Sep 05 12:40:52.720503 2024] [php:warn] [pid 1552] [client 1.1.1.1:44786] PHP Warning: Undefined array key "config_ticket_default_billable " in /var/www/itflow.company.com/get_settings.php on line 75, referer: https://itflow.company.com/admin_users.php

[Thu Sep 05 12:40:52.720520 2024] [php:warn] [pid 1552] [client 1.1.1.1:44786] PHP Warning: Undefined array key "config_log_retention" in /var/ www/itflow.company.com/get_settings.php on line 117, referer: https://itflow.company.com/admin_users.php

[Thu Sep 05 12:40:54.601986 2024] [php:notice] [pid 1552] [client 1.1.1.1:44786] MySQL error: Table 'itflow.user_permissions' doesn't exist, ref erer: https://itflow.company.com/admin_api.php

[Thu Sep 05 12:40:54.602261 2024] [php:warn] [pid 1552] [client 1.1.1.1:44786] PHP Warning: Undefined array key "config_ticket_default_billable " in /var/www/itflow.company.com/get_settings.php on line 75, referer: https://itflow.company.com/admin_api.php

[Thu Sep 05 12:40:54.602279 2024] [php:warn] [pid 1552] [client 1.1.1.1:44786] PHP Warning: Undefined array key "config_log_retention" in /var/ www/itflow.company.com/get_settings.php on line 117, referer: https://itflow.company.com/admin_api.php

[Thu Sep 05 12:41:04.883471 2024] [php:notice] [pid 1726] [client 1.1.1.1:20998] MySQL error: Table 'itflow.user_permissions' doesn't exist, ref erer: https://itflow.company.com/admin_bulk_mail.php

[Thu Sep 05 12:41:04.889437 2024] [php:warn] [pid 1726] [client 1.1.1.1:20998] PHP Warning: Undefined array key "config_ticket_default_billable " in /var/www/itflow.company.com/get_settings.php on line 75, referer: https://itflow.company.com/admin_bulk_mail.php

[Thu Sep 05 12:41:04.889474 2024] [php:warn] [pid 1726] [client 1.1.1.1:20998] PHP Warning: Undefined array key "config_log_retention" in /var/ www/itflow.company.com/get_settings.php on line 117, referer: https://itflow.company.com/admin_bulk_mail.php

russworkalot

it appears the itflow.company.com/admin_users.php page is blank and unresponsive as well

wrongecho

MySQL error: Table 'itflow.user_permissions' doesn't exist

This was added 4 months ago..

What commit/"Current App Version" are you on (demo.itflow.org/admin_update.php)?

wrongecho

Also: From the debug page, please post your database structure check output. The fields in bold should match against the demo/below.

`Database Structure Check`

`Database stats`

Number of tables:94
Total number of fields:923
Total number of rows: --ignore --
Current Database Version:1.4.6

russworkalot

Current Database Version:
1.4.6

Current App Version:
d890a27731d63cf2a24dc9b2b594cac3e3f3f86d

Branch:
master

Database Structure Check

Database stats

Number of tables: 86
Total number of fields: 858
Total number of rows: 797
Current Database Version: 1.4.6

You are up to date!

wrongecho

russworkalot

You're missing quite a few database schema updates. Have you just been updating normally clicking the database update button each time? I'm struggling to understand how this would have happened.

russworkalot

Yes just the normal database update button wait for next one repeat. And typically do it at a minimum monthly if not sooner. We weren't way behind and then tried to catch up so updates have been applied fairly regularly via maintenance update.

Also have never received any error messages during the update process so seemed like updates were working normally.

Bigbug

it made me thinking of how about implementing automatic updates?
which of course should be configurable on/off and with ability to set delays

we actually have an update check in nightly cron, maybe add this to it?

wrongecho

Bigbug

Auto updates would be nice, but doesn't seem like they would've helped whatever went wrong here.

Only blocker is we need a way to flag if a user login is needed (as anything to do with creds/client logins username & passwords needs a user logged in). Though we probably won't need to change these for a while.

In terms of delaying updates, that's a wider conversation around how we handle releases. Even more established projects seem to struggle with that.

Best for a separate thread.

wrongecho

It's really strange. I've seen it skip a single update, but never this many. The update logic is fairly stable at this point.

I think it's worth comparing your own debug Table Stats against the demo debug to see exactly what tables and columns within those tables you're missing (you can ignore rows). You can then create the missing tables/columns using the CLI/phpMyAdmin against db.sql / the database updater script.

It seems like you're missing from around here onwards.

russworkalot

I have copied both tables to excel spreadsheet but wont let me upload here. How would I go about comparing what tables I need vs the tables in demo db.

for example I am missing user_roles and user_permissions in my tables compared to demo.

johnny

Hi @russworkalot it might be worth restoring from backup then retry the update just to see if it can be replicated.

russworkalot

Can I just setup a new instance and restore a backup or will the restore be missing the tables as well?

wrongecho

russworkalot

Yeah - a new install should have the the latest tables, so you should be able to just restore your data into it.

russworkalot

ok have setup new instance and compared tables etc. when I try to import sql backup from old instance no data populates and I get a few errors. Not sure if they are relevant or not but new instance has no clients or data etc. what else am I missing on restoring data?

`account_type_description` text DEFAULT NULL, `account_type_created_at` datetime NOT NULL DEFAULT current_timestamp(), `account_type_updated_at` datetime DEFAULT NULL ON UPDATE current_timestamp(), `account_type_archived_at` datetime DEFAULT NULL, PRIMARY KEY (`account_type_id`) ) ENGINE=InnoDB AUTO_INCREMENT=31 DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_general_ci;

MySQL said:

#1050 - Table 'account_types' already exists

wrongecho

russworkalot

Try forcing the import as the database already exists. Alternatively adjust the export to just be the data instead of the table creation as well.

https://dev.mysql.com/doc/refman/8.4/en/mysql-command-options.html#option_mysql_force