Company: Link Technologies
Case No: L13041. Project: 15.40: LinkSOFT Version 15.40
Logged By: Sanjay (Link Technologies) on 22 May 2024 02:57PM
Priority: Medium
Product: Payroll & HR
Group: Enhancement
Time Taken: 23.00 (Weight: 36.00)
Assigned To: Sanjay (Link Technologies)
Circulation: Sanjay, Vineet
Resolve By: Thursday, 30 May 2024 03:37 PM [109 days since logged date]
Status: Closed
Subject: "Pay Close" takes 35 minutes for 700 employees. Can we speed this up?
Summary:    

Bula Link Team

Pay update is slow. See the event log for last week's pay. Our pay has been continuously being delayed week after week and we are not into our 3rd week of pay. Appreciate your team's urgent attention and assistance on this matter

Event Log Queue Process completed - Reference: HRM.PayrunClose. EventLogTimeLimit(s): 10 Start: 17-05-24 02:20:50 PM Finish: 17-05-24 04:00:03 PM Duration: 1h 39m 13s [Company: 1001]

Environment: http://10.0.0.18/CLIENT-GFI-LinkSOFT/

Audit Notes:Edited by sanjay on 24/07/24 12:14. Edited by sanjay on 28/05/24 10:31. Edited by sanjay on 24/05/24 09:52. Edited by sanjay on 22/05/24 14:57. 
21 May 202408:20AM Comment 1 by Vineet (Link Business Solutions) This comment has been removed
22 May 202407:36AM Comment 2 by Vineet (Link Business Solutions) This comment has been removed
22 May 202408:54AM Comment 3 by Sanjay (Link Technologies) This comment has been removed
22 May 202409:02AM Comment 4 by Sanjay (Link Technologies) Assigned To: Sanjay (Link Technologies) Followup Date: 23-05-2024 08:54 AM Time Taken: 2.00 Notes: Edited by sanjay on 22/05/24 09:08. 

Morning Vineet,

Just FYI - Pay Close on LinkQA4 takes 15 minutes. Since you are using Timesheet, and you have over 10 years of data, your server needs to be built to handle the volume.

Please make sure GFI perform database maintenance. Here are some notes from what I observed:

  1. Indexing issues on the database
  2. Database is configured on the same server as Web server. This is not recommended if you are enabling audit and if the database is bigger than 20GB. See Microsoft Best practices. Configure segmenting the data files.

Regards
Sanjay


22 May 202412:41PM Comment 5 by Vineet (Link Business Solutions) This comment has been removed
22 May 202412:45PM Comment 6 by Vineet (Link Business Solutions) This comment has been removed
22 May 202402:56PM Comment 7 by Sanjay (Link Technologies) Case L13041 added to project 15.40
22 May 202403:37PM Comment 8 by Vineet (Link Business Solutions) This comment has been removed
24 May 202409:58AM Comment 9 by Sanjay (Link Technologies) Assigned To: Sanjay (Link Technologies) Followup Date: 30-05-2024 09:52 AM Time Taken: 6.00 Notes: Edited by sanjay on 24/05/24 10:01. 

I was informed that before upgrading, the client had the WEB Server and Databases Server on separate machines. Vineet failed to include this parameter when comparing the speed between the OLD system and the New Version.

Furthermore, Databases Maintenance is not included in the LinkSOFT Support. This is a Microsoft DB task and should be managed by the client. However, we have provided some tools to assist with this. See process SYS008.

Below are the actual Execution times from the environment we have. The time provided in the case header is misleading as it was based on fragmented and poorly maintained database.

We will see what else we can do to speed this up in the next release.

Figure 1 - Event log showing processing times
Standard Pay Close: Event Log Payroll Processing - Pay Closed. Payrun: 3986, Company: 1001, Number of Employees: 296 Start: 23-05-24 04:18:51 PM Finish: 23-05-24 04:20:33 PM Duration: 1m 42s [Company: 1001]
Timesheet Pay Close: Event Log Payroll Processing - Pay Closed. Payrun: 3985, Company: 1001, Number of Employees: 699 Start: 23-05-24 04:20:33 PM Finish: 23-05-24 04:56:04 PM Duration: 35m 31s [Company: 1001]


28 May 202410:30AM Comment 10 by Sanjay (Link Technologies) Assigned To: Sanjay (Link Technologies) Followup Date: 31-05-2024 10:28 AM Time Taken: 6.00
PART A - Development work for this case has been completed.

1. The change will be available in version: 15.40 and 15.30.240527

2. The following changes were made (Include Database object names, Program classes, and any other relevant information):

  1. Added Database indexes specific to customer using large Timesheet volumes

3. Affected Areas:

  1. Pay Close function

4. The issue was caused by:

  1. Performance Improvement

5. Other Relevant Notes: 
6. Next Step (Review and System Test (Developer) -> UAT (Quality) -> Documentation): UAT


29 May 202403:26PM Comment 11 by Sanjay (Link Technologies) Assigned To: Sanjay (Link Technologies) Followup Date: 06-06-2024 02:40 PM Time Taken: 9.00
The following tests were performed:

Test Setup Instructions:
  1. 15.40 and GFI DB on LinkQA4\SQL2022. Upgraded to version 15.30.15.30.2505
  2. LinkQA4 is 4 VCPU with 16GB RAM + over 1TB of active customer databases. Most customer servers is expected to be 10x in performance.
  3. > 5 Million Time Entry Records
  4. ~ 3917 User Profiles
  5. ~ 3755 Pays processed since 2012.
  6. No Archive processes applied to this database.
  7. Database Size: 80GB
Table 1 - Test Results
NoTest CaseExpected ResultPass/FailComments
1Pay Close for 296 employees
Expect Close to process to take a resonable time given the server specs. In this case ~10 min = 1 employee per second.
Pass
Event Log Payroll Processing - Pay Closed. Payrun: 3986, Company: 1001, Number of Employees: 296 Start: 29-05-24 02:46:30 PM Finish: 29-05-24 02:52:56 PM Duration: 6m 26s [Company: 1001]
2
Run the "Reindex" process
Run Reindex nightly
Pass
Event Log "Rebuild Index" was run using these parameters: Fragmentation Percent: 20, Rebuild: Y, Reorganise: N. ShrinkDB: N. Number of fragmented indexes found: 23 Start: 29-05-24 02:53:30 PM Finish: 29-05-24 02:53:48 PM Duration: 18s
3
Pay Close for 699 employees
Expect Close to process to take a resonable time given the server specs. In this case ~30 min = 1 employee every 2 seconds.
Pass
Event Log Payroll Processing - Pay Closed. Payrun: 3985, Company: 1001, Number of Employees: 699 Start: 29-05-24 02:54:30 PM Finish: 29-05-24 03:22:15 PM Duration: 27m 45s [Company: 1001]

Environment Details

  1. OS version: Win11
  2. Application version: 15.30.15.30.2505
  3. Setup on:
    1. Server: LinkQA4
    2. Database: LinkSOFT
    3. LinkSOFT URL: HTTP://LinkQA4/LinkSOFT
  4. Login Details: Standard username and password for user "admin"

Next Step: Closure


Attachments:
General Documents - Case: L13041:Reindex.txt
If you have any queries regarding this support incident, please email admin@linktechnologies.com.au and include the Case No: L13041 in the subject line of all emails regarding this issue.

Document size: 17.5 KB
For call complaints, please contact the Managing Director of the company using this form.