Incorrect domain expiration data .be TLD

qduchenne

Hi,

Everytime I edit a domain name it resets the expiration date to current date

wrongecho

Hey,

Is this just certain TLDs?

Can you reproduce on the demo?

qduchenne

I have it for evey domain name for each client.

Strange I can't reproduce on the demo.

I realized I have another behavior on my instance than on the demo.

when I do an action it redirects me to :

wrongecho

Did you switch to MariaDB in the end? Not sure if it's related, but as I mentioned previously MySQL isn't supported and you'll run into weird things with dates.

Is the domain info (expiration, records, whois, etc) correctly pulled the first time you add a domain?

Does the VM running ITFlow have outbound Internet access?

Do you have any "privacy" related browser extensions? We use the HTTP 'referer' header to know where to send you after you submit forms - some extensions remove this causing the a blank redirect. The fact you can't reproduce on the demo would suggest not, but it doesn't hurt to ask.

qduchenne

Yes I have created a brand new server and migrated everything on it.

Records, Certificate, … Are correct when creating the domain name. Expiration date, not.

Yes, VM has full access to internet. On ongoing traffic is filtered (80/443 from everywhere, 22 from specific IPs)

No privacy extensions installed and I'm sure it's not the issue as I open the demo on the same browser 🙂

wrongecho

I see, thanks.

Can you just double check the output of the following commands from the server when connected via console/SSH:

curl lookup.itflow.org:8080/itflow.org

curl lookup.itflow.org:8080/google.com

qduchenne

Here it is :

wrongecho

Thanks, so you're not blocked from the lookup service or anything.

Could you please run a tail -F /var/log/apache2/error.log

And then attempt both a domain add and domain edit and share any error logs that are appended? (I don't need the full log, just any errors generated as a result of the domain add/edit operations).

qduchenne

Here is the result :

[Sat Nov 18 17:45:27.915854 2023] [php:warn] [pid 802] [client 123.123.123.123:35182] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 380, referer: https://ITFLOW_FOLDER/

[Sat Nov 18 17:45:27.915894 2023] [php:warn] [pid 802] [client 123.123.123.123:35182] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 384, referer: https://ITFLOW_FOLDER/

[Sat Nov 18 17:53:11.818850 2023] [php:warn] [pid 1059] [client 123.123.123.123:60786] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 380, referer: https://ITFLOW_FOLDER/

[Sat Nov 18 17:53:11.818895 2023] [php:warn] [pid 1059] [client 123.123.123.123:60786] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 384, referer: https://ITFLOW_FOLDER/

[Sat Nov 18 17:53:44.534510 2023] [php:warn] [pid 1045] [client 123.123.123.123:50466] PHP Warning: stream_socket_client(): Unable to connect to ssl://****.be:443 (Connection refused) in /var/www/ITFLOW_FOLDER/functions.php on line 436, referer: https://ITFLOW_FOLDER/

[Sat Nov 18 17:56:54.666425 2023] [mpm_prefork:notice] [pid 764] AH00170: caught SIGWINCH, shutting down gracefully

[Sat Nov 18 17:56:54.829019 2023] [mpm_prefork:notice] [pid 1174] AH00163: Apache/2.4.52 (Ubuntu) OpenSSL/3.0.2 configured -- resuming normal operations

[Sat Nov 18 17:56:54.829065 2023] [core:notice] [pid 1174] AH00094: Command line: '/usr/sbin/apache2'

[Sat Nov 18 17:57:19.490267 2023] [php:warn] [pid 1176] [client 123.123.123.123:51700] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 380, referer: https://ITFLOW_FOLDER/client_domains.php?client_id=1

[Sat Nov 18 17:57:19.490316 2023] [php:warn] [pid 1176] [client 123.123.123.123:51700] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 384, referer: https://ITFLOW_FOLDER/client_domains.php?client_id=1

[Sat Nov 18 17:58:04.597817 2023] [php:warn] [pid 1177] [client 123.123.123.123:50210] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 380, referer: https://ITFLOW_FOLDER/client_domains.php?client_id=1

[Sat Nov 18 17:58:04.597889 2023] [php:warn] [pid 1177] [client 123.123.123.123:50210] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 384, referer: https://ITFLOW_FOLDER/client_domains.php?client_id=1

[Sat Nov 18 17:58:19.118647 2023] [php:warn] [pid 1193] [client 123.123.123.123:42630] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 380, referer: https://ITFLOW_FOLDER/client_domains.php?client_id=1

[Sat Nov 18 17:58:19.118738 2023] [php:warn] [pid 1193] [client 123.123.123.123:42630] PHP Warning: Undefined array key "expiration_date" in /var/www/ITFLOW_FOLDER/functions.php on line 384, referer: https://ITFLOW_FOLDER/client_domains.php?client_id=1

qduchenne

BTW I fixed the referrer issue 😉

I switched from :

Header always set Referrer-Policy "strict-origin"

To :

Header always set Referrer-Policy "same-origin"

in my Apache2 security config

wrongecho

qduchenne

Thanks for sharing. Is that something you'd added as part of hardening, or Apache default out of the box?

wrongecho

Just to be clear, what TLDs are you using? You left one unredacted ending in .be and it seems the lookup service can't properly read data for that TLD.

What happens when you try something like google.co.uk?

qduchenne

wrongecho added as part of the hardening 😉

qduchenne

adding google.com gives me a correct expiration date.

It might come from me registrer "Gandi.net" and "OVH.com"

qduchenne

And forgot to reply.

My TLD are .be in this case

wrongecho

It'll be in how the Registry (not the registrar) returns the data. We had a case of this recently - here.

Is it just .be domains or are there others? I can look into trying to correct locally and then asking for an upstream patch.

qduchenne

Looks like you won't be able to fix that…

http://lookup.itflow.org:8080/acv.be

Result :

{"email":null,"fax":null,"name":"Gandi Sas","org":"Gandi SAS","phone":"+33.170377661"}

Seems like I have those issues only for .be

This is probably one of my lovely country law blocking those info 😉

wrongecho

Closing as per itflow-org/itflow869

"Running a raw whois against several of these domains does not show any expiry date in the whois response. Can't scrape what isn't there!"