EUDAT-TOOLS issueshttps://gitlab.eudat.eu/groups/EUDAT-TOOLS/-/issues2017-12-14T11:13:09+01:00https://gitlab.eudat.eu/EUDAT-TOOLS/eudat-accounting-client/-/issues/1multiple users/accounts?2017-12-14T11:13:09+01:00Johannes Reetzjohannes.reetz@mpcdf.mpg.demultiple users/accounts?*Created by: cookie33*
Hi,
We store data of multiple institutes in one iRODS configuration for eudat.
Is it possible to generate several uploads of data to eudat for different insititutes and differentiate:
* institute A has x by...*Created by: cookie33*
Hi,
We store data of multiple institutes in one iRODS configuration for eudat.
Is it possible to generate several uploads of data to eudat for different insititutes and differentiate:
* institute A has x bytes and y files
* institute B has z bytes and q fileshttps://gitlab.eudat.eu/EUDAT-TOOLS/eudat-accounting-client/-/issues/2location of files, rpm and python 2.6?2017-06-20T15:57:54+02:00Johannes Reetzjohannes.reetz@mpcdf.mpg.delocation of files, rpm and python 2.6?*Created by: cookie33*
Hi,
It creates some files. Where does it put them? It only states bin/<filename>. Which bin directory where?
And can I create an rpm using
```
python setup.py bdist_rpm
```
We do NOT want to use pip. A...*Created by: cookie33*
Hi,
It creates some files. Where does it put them? It only states bin/<filename>. Which bin directory where?
And can I create an rpm using
```
python setup.py bdist_rpm
```
We do NOT want to use pip. And no docker or virtualenv. It has to run on a machine without doing anything which is NOT out of the box supported.
We use Centos and python 2.6. Is that supported?
https://gitlab.eudat.eu/EUDAT-TOOLS/eudat-accounting-client/-/issues/3Dry run for addRecord disfunctional2017-08-25T14:35:39+02:00Johannes Reetzjohannes.reetz@mpcdf.mpg.deDry run for addRecord disfunctional*Created by: raphael-ritz*
addRecord claims to support a "dry run" option via the -t flag but doesn't. Only the iRODS collector does this at the moment.*Created by: raphael-ritz*
addRecord claims to support a "dry run" option via the -t flag but doesn't. Only the iRODS collector does this at the moment.https://gitlab.eudat.eu/EUDAT-TOOLS/eudat-accounting-client/-/issues/4eudat.accounting.client creates hidden file2017-12-14T11:11:25+01:00Johannes Reetzjohannes.reetz@mpcdf.mpg.deeudat.accounting.client creates hidden file*Created by: cookie33*
Hi,
The client creates a hidden file:
```
.accounting.log
```
THIS is BAD!!!
It should not create a hidden file while the config file has a config file defined.*Created by: cookie33*
Hi,
The client creates a hidden file:
```
.accounting.log
```
THIS is BAD!!!
It should not create a hidden file while the config file has a config file defined.https://gitlab.eudat.eu/EUDAT-TOOLS/eudat-accounting-client/-/issues/6accounting numbers are incorrect with compound resources2017-12-20T09:22:06+01:00Johannes Reetzjohannes.reetz@mpcdf.mpg.deaccounting numbers are incorrect with compound resources*Created by: cookie33*
Hi,
We have a compound resource with files in both cache and archive resources. We want them counted only once per compound resource. The accounting script gives:
```
2017-12-20 07:00:16,217 - StorageAccoun...*Created by: cookie33*
Hi,
We have a compound resource with files in both cache and archive resources. We want them counted only once per compound resource. The accounting script gives:
```
2017-12-20 07:00:16,217 - StorageAccounting - INFO - Storage space for collection: /vzSARA1/home/rods#replixRZG: 42
2017-12-20 07:00:16,390 - StorageAccounting - INFO - number of objects for collection /vzSARA1/home/rods#replixRZG: 14
```
The `ils -r` gives:
```
ils -r /vzSARA1/home/rods#replixRZG
/vzSARA1/home/rods#replixRZG:
1.txt
2.txt
3.txt
4.txt
5.txt
6.txt
7.txt
8.txt
t5.txt
test00.txt
test01.txt
C- /vzSARA1/home/rods#replixRZG/1
/vzSARA1/home/rods#replixRZG/1:
C- /vzSARA1/home/rods#replixRZG/1/11
/vzSARA1/home/rods#replixRZG/1/11:
C- /vzSARA1/home/rods#replixRZG/1/11/111
/vzSARA1/home/rods#replixRZG/1/11/111:
1.txt
```
So it are 12 files and not 14.
The `ils -lr` gives:
```
ils -rl /vzSARA1/home/rods#replixRZG
/vzSARA1/home/rods#replixRZG:
rods 1 eudat;eudatPnfs 2 2015-10-20.16:02 & 1.txt
rods 1 eudat;eudatPnfs 3 2015-10-20.16:07 & 2.txt
rods 1 eudat;eudatPnfs 3 2015-10-20.16:57 & 3.txt
rods 1 eudat;eudatPnfs 3 2015-10-21.14:35 & 4.txt
rods 0 eudat;eudatCache 3 2015-10-26.15:01 & 5.txt
rods 1 eudat;eudatPnfs 3 2015-10-26.15:01 & 5.txt
rods 1 eudat;eudatPnfs 3 2015-10-21.14:33 & 6.txt
rods 1 eudat;eudatPnfs 5 2015-10-21.14:32 & 7.txt
rods 1 eudat;eudatPnfs 3 2015-10-21.14:22 & 8.txt
rods 0 demoResc 4 2015-12-04.17:45 & t5.txt
rods 0 eudat;eudatCache 3 2015-10-20.12:33 & test00.txt
rods 1 eudat;eudatPnfs 3 2015-10-20.16:01 & test01.txt
C- /vzSARA1/home/rods#replixRZG/1
/vzSARA1/home/rods#replixRZG/1:
C- /vzSARA1/home/rods#replixRZG/1/11
/vzSARA1/home/rods#replixRZG/1/11:
C- /vzSARA1/home/rods#replixRZG/1/11/111
/vzSARA1/home/rods#replixRZG/1/11/111:
rods 0 eudat;eudatCache 2 2015-10-26.20:29 & 1.txt
rods 1 eudat;eudatPnfs 2 2015-10-26.20:29 & 1.txt
```
There are 2 files with a copy in cache and in the archive resource, both part of the eudat compound resource. So they are counted twice. For bytes and file number.
We do not want this.
And because of this our numbers for some accounting metrics are off by more than 20TiB
Please fix this.
https://gitlab.eudat.eu/EUDAT-TOOLS/eudat-accounting-client/-/issues/9Take non-iRODS resources into acccout ?2018-06-14T16:49:17+02:00Johannes Reetzjohannes.reetz@mpcdf.mpg.deTake non-iRODS resources into acccout ?*Created by: sviscapi*
Dear @raphael-ritz ,
We have ~24TB of data registered in the HERBADROP-B2SAFE project:
https://dp.eudat.eu/providers/CINES/herbadrop-b2safe
Part of this data has also been archived for long term preservat...*Created by: sviscapi*
Dear @raphael-ritz ,
We have ~24TB of data registered in the HERBADROP-B2SAFE project:
https://dp.eudat.eu/providers/CINES/herbadrop-b2safe
Part of this data has also been archived for long term preservation in another part of our computing system (not related to iRODS AFAIK), but is not accounted for (yet).
Would it be possible to take non-iRODS resources into account with the EUDAT client ?
Best regards,
Samuel, from CINEShttps://gitlab.eudat.eu/EUDAT-TOOLS/eudat-accounting-client/-/issues/10non-existent or empty collections cause exception with exist error status 12018-08-09T12:34:00+02:00Johannes Reetzjohannes.reetz@mpcdf.mpg.denon-existent or empty collections cause exception with exist error status 1*Created by: janiheikkinen*
Non-existent or empty collections to be accounted causes exception with exist error status 1.
Exception invalid literal for int() with base 10: '' encountered!
$ iRODScollector --version
1.0.1
*Created by: janiheikkinen*
Non-existent or empty collections to be accounted causes exception with exist error status 1.
Exception invalid literal for int() with base 10: '' encountered!
$ iRODScollector --version
1.0.1
https://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/1In svmon-front table, the column status is not shown after service component ...2018-10-24T10:04:41+02:00Yannick NesselhaufIn svmon-front table, the column status is not shown after service component is writtenIn svmon-front table, the column status is not shown after service component is written. However, before the pakiti report is written, the status is shown as "production".In svmon-front table, the column status is not shown after service component is written. However, before the pakiti report is written, the status is shown as "production".https://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/2In svmon-front, the shown table can not support to show multiple service comp...2018-10-24T10:02:51+02:00Yannick NesselhaufIn svmon-front, the shown table can not support to show multiple service componentsIn svmon-front, the shown table can not support to show multiple service components. But in reality we have such hosts with several service components. We need to modify the table structure.In svmon-front, the shown table can not support to show multiple service components. But in reality we have such hosts with several service components. We need to modify the table structure.https://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/3Repeated CORS requests of svmon front2019-01-23T14:26:44+01:00Yannick NesselhaufRepeated CORS requests of svmon frontThe svmon front repeatedly request resources from backend. This makes the workload of svmon backend much more heavier.The svmon front repeatedly request resources from backend. This makes the workload of svmon backend much more heavier.https://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/4Security with Pakiti client2018-10-11T12:38:39+02:00Yannick NesselhaufSecurity with Pakiti clientCurrently, no agreements have been achieved with Daniel to secure our endpoint to receive pakiti reports.Currently, no agreements have been achieved with Daniel to secure our endpoint to receive pakiti reports.https://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/5Production Tag for service component is not implemented (backend)2018-10-24T10:00:11+02:00Yannick NesselhaufProduction Tag for service component is not implemented (backend)For the service component, the production tag is not implemented in the backendFor the service component, the production tag is not implemented in the backendhttps://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/6ip address statistics2022-01-26T14:31:23+01:00Yannick Nesselhaufip address statisticsIt is used to satisfy the metric of svmon.It is used to satisfy the metric of svmon.https://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/7sidebar can not fold2019-01-23T14:26:36+01:00Yannick Nesselhaufsidebar can not foldWithin sidebar, it is designed that the click on "DPMT/GOCDB Software Products" should fold or unfold the site names.Within sidebar, it is designed that the click on "DPMT/GOCDB Software Products" should fold or unfold the site names.https://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/8table paging2019-01-23T14:26:08+01:00Yannick Nesselhauftable pagingcurrent paging is not supported, could be implemented for improvingcurrent paging is not supported, could be implemented for improvinghttps://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/9time stamp of sevice component record2018-11-13T11:15:31+01:00Yannick Nesselhauftime stamp of sevice component recordWe should update the timestamp each time when a new report comes, even though no real updates from service componentsWe should update the timestamp each time when a new report comes, even though no real updates from service componentshttps://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/10multiple view in the front2019-01-23T14:25:16+01:00Yannick Nesselhaufmultiple view in the frontwe need a hierarchical view and a compact view of all service componentswe need a hierarchical view and a compact view of all service componentshttps://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/11angular version too old2021-06-21T19:02:04+02:00Yannick Nesselhaufangular version too oldmigrate the angular version up-to-date, so we can use more modules.migrate the angular version up-to-date, so we can use more modules.https://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/svmon-app/-/issues/12add third view to svmon front2019-01-15T10:20:22+01:00Yannick Nesselhaufadd third view to svmon frontA third view, especially for eosc(-hub) services, is requested.A third view, especially for eosc(-hub) services, is requested.https://gitlab.eudat.eu/EUDAT-TOOLS/SVMON/pysvmon/-/issues/1migrate commands package to subprocess2022-01-26T14:31:18+01:00Yannick Nesselhaufmigrate commands package to subprocesspython3 does not support commands package, subprocess is universalpython3 does not support commands package, subprocess is universal