Skip to content

GitLab

  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • E eudat-accounting-client
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 5
    • Issues 5
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 3
    • Merge requests 3
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • EUDAT-TOOLS
  • eudat-accounting-client
  • Issues
  • #6

Closed
Open
Created Dec 20, 2017 by Johannes Reetz@johannes.reetzOwner

accounting numbers are incorrect with compound resources

Created by: cookie33

Hi,

We have a compound resource with files in both cache and archive resources. We want them counted only once per compound resource. The accounting script gives:

2017-12-20 07:00:16,217 - StorageAccounting                         - INFO - Storage space for collection: /vzSARA1/home/rods#replixRZG: 42
2017-12-20 07:00:16,390 - StorageAccounting                         - INFO - number of objects for collection /vzSARA1/home/rods#replixRZG: 14

The ils -r gives:

ils -r  /vzSARA1/home/rods#replixRZG
/vzSARA1/home/rods#replixRZG:
  1.txt
  2.txt
  3.txt
  4.txt
  5.txt
  6.txt
  7.txt
  8.txt
  t5.txt
  test00.txt
  test01.txt
  C- /vzSARA1/home/rods#replixRZG/1
/vzSARA1/home/rods#replixRZG/1:
  C- /vzSARA1/home/rods#replixRZG/1/11
/vzSARA1/home/rods#replixRZG/1/11:
  C- /vzSARA1/home/rods#replixRZG/1/11/111
/vzSARA1/home/rods#replixRZG/1/11/111:
  1.txt

So it are 12 files and not 14.

The ils -lr gives:

ils -rl  /vzSARA1/home/rods#replixRZG
/vzSARA1/home/rods#replixRZG:
  rods              1 eudat;eudatPnfs            2 2015-10-20.16:02 & 1.txt
  rods              1 eudat;eudatPnfs            3 2015-10-20.16:07 & 2.txt
  rods              1 eudat;eudatPnfs            3 2015-10-20.16:57 & 3.txt
  rods              1 eudat;eudatPnfs            3 2015-10-21.14:35 & 4.txt
  rods              0 eudat;eudatCache            3 2015-10-26.15:01 & 5.txt
  rods              1 eudat;eudatPnfs            3 2015-10-26.15:01 & 5.txt
  rods              1 eudat;eudatPnfs            3 2015-10-21.14:33 & 6.txt
  rods              1 eudat;eudatPnfs            5 2015-10-21.14:32 & 7.txt
  rods              1 eudat;eudatPnfs            3 2015-10-21.14:22 & 8.txt
  rods              0 demoResc            4 2015-12-04.17:45 & t5.txt
  rods              0 eudat;eudatCache            3 2015-10-20.12:33 & test00.txt
  rods              1 eudat;eudatPnfs            3 2015-10-20.16:01 & test01.txt
  C- /vzSARA1/home/rods#replixRZG/1  
/vzSARA1/home/rods#replixRZG/1:
  C- /vzSARA1/home/rods#replixRZG/1/11  
/vzSARA1/home/rods#replixRZG/1/11:
  C- /vzSARA1/home/rods#replixRZG/1/11/111  
/vzSARA1/home/rods#replixRZG/1/11/111:
  rods              0 eudat;eudatCache            2 2015-10-26.20:29 & 1.txt
  rods              1 eudat;eudatPnfs            2 2015-10-26.20:29 & 1.txt

There are 2 files with a copy in cache and in the archive resource, both part of the eudat compound resource. So they are counted twice. For bytes and file number.

We do not want this.

And because of this our numbers for some accounting metrics are off by more than 20TiB

Please fix this.

Assignee
Assign to
Time tracking