Hi
We have integrated veraPDF validation-model 1.8.1 from the maven repo (https://mvnrepository.com/artifact/org.verapdf/validation-model) into the eHealth Connector Open Source project (see https://sourceforge.net/projects/ehealthconnector/). See https://sourceforge.net/p/ehealthconnector/wiki/CDA%20Validation/ for more information.
The eHealth Connector supports multithreading, but veraPDF seems not currently to be thread-safe. Is there any plan for a thread-safe veraPDF validation-model?
Thanks in advance for any response.
Regards, Tony
Hi all Any advice? Thanks and kind regards, Tony
Von: Tony Schaller Gesendet: Montag, 30. Oktober 2017 15:32 An: 'users@lists.verapdf.org' users@lists.verapdf.org Betreff: veraPDF and thread-safeness?
Hi
We have integrated veraPDF validation-model 1.8.1 from the maven repo (https://mvnrepository.com/artifact/org.verapdf/validation-model) into the eHealth Connector Open Source project (see https://sourceforge.net/projects/ehealthconnector/). See https://sourceforge.net/p/ehealthconnector/wiki/CDA%20Validation/ for more information.
The eHealth Connector supports multithreading, but veraPDF seems not currently to be thread-safe. Is there any plan for a thread-safe veraPDF validation-model?
Thanks in advance for any response.
Regards, Tony
Dear Tony,
The performance and the memory optimization are our primary targets this and the next release. The coming release (1.10) will include a lot of memory optimization and significantly better performance in case of large test documents.
Thread-safeness is in the plans for the next release expected in first quarter of 2018. But if you are interested, we would be able to provide the dev version for tests a bit earlier (end of December or beginning of January).
Best regards, Boris
From: Users [mailto:users-bounces@lists.verapdf.org] On Behalf Of Tony Schaller Sent: Monday, November 6, 2017 10:48 AM To: users@lists.verapdf.org Subject: Re: [Users] veraPDF and thread-safeness?
Hi all Any advice? Thanks and kind regards, Tony
Von: Tony Schaller Gesendet: Montag, 30. Oktober 2017 15:32 An: 'users@lists.verapdf.org' <users@lists.verapdf.orgmailto:users@lists.verapdf.org> Betreff: veraPDF and thread-safeness?
Hi
We have integrated veraPDF validation-model 1.8.1 from the maven repo (https://mvnrepository.com/artifact/org.verapdf/validation-model) into the eHealth Connector Open Source project (see https://sourceforge.net/projects/ehealthconnector/). See https://sourceforge.net/p/ehealthconnector/wiki/CDA%20Validation/ for more information.
The eHealth Connector supports multithreading, but veraPDF seems not currently to be thread-safe. Is there any plan for a thread-safe veraPDF validation-model?
Thanks in advance for any response.
Regards, Tony
Hi Boris
Thanks a lot for your message and your offer! We definitely appreciate a dev version and we therefore also will feed back our test results. Please take in account that temp. files in my opinion are problematic for thread safeness. On the other hand big pdfs are problematic for memory consumption. Therefore it was perfect, if one can configure the veraPDF validation engine whether one would have seamless validation by streams (without creation of temp. files) or if one would like to reduce memory usage and therefore allow temp files. Anyway, the temp folder should be configurable in order to respect access right policies (i.e. when used on servers).
Kind regards, Tony
Von: Boris Doubrov [mailto:boris.doubrov@duallab.com] Gesendet: Montag, 6. November 2017 11:05 An: Tony Schaller tony.schaller@medshare.net; users@lists.verapdf.org Betreff: RE: veraPDF and thread-safeness?
Dear Tony,
The performance and the memory optimization are our primary targets this and the next release. The coming release (1.10) will include a lot of memory optimization and significantly better performance in case of large test documents.
Thread-safeness is in the plans for the next release expected in first quarter of 2018. But if you are interested, we would be able to provide the dev version for tests a bit earlier (end of December or beginning of January).
Best regards, Boris
From: Users [mailto:users-bounces@lists.verapdf.org] On Behalf Of Tony Schaller Sent: Monday, November 6, 2017 10:48 AM To: users@lists.verapdf.orgmailto:users@lists.verapdf.org Subject: Re: [Users] veraPDF and thread-safeness?
Hi all Any advice? Thanks and kind regards, Tony
Von: Tony Schaller Gesendet: Montag, 30. Oktober 2017 15:32 An: 'users@lists.verapdf.org' <users@lists.verapdf.orgmailto:users@lists.verapdf.org> Betreff: veraPDF and thread-safeness?
Hi
We have integrated veraPDF validation-model 1.8.1 from the maven repo (https://mvnrepository.com/artifact/org.verapdf/validation-model) into the eHealth Connector Open Source project (see https://sourceforge.net/projects/ehealthconnector/). See https://sourceforge.net/p/ehealthconnector/wiki/CDA%20Validation/ for more information.
The eHealth Connector supports multithreading, but veraPDF seems not currently to be thread-safe. Is there any plan for a thread-safe veraPDF validation-model?
Thanks in advance for any response.
Regards, Tony
Hi Tony,
We do have already the functionality of storing temp files (or rather decoded chunks of data) in memory up to a certain limit, and moving them to the temp files above this limit.
At the moment the limit is quite low (10K or so) and is a constant in the code. We’ll open this parameter to the library configuration, so that the user would be able to control this.
Best regards, Boris
From: Tony Schaller [mailto:tony.schaller@medshare.net] Sent: Tuesday, November 7, 2017 11:39 AM To: Boris Doubrov boris.doubrov@duallab.com; users@lists.verapdf.org Subject: AW: veraPDF and thread-safeness?
Hi Boris
Thanks a lot for your message and your offer! We definitely appreciate a dev version and we therefore also will feed back our test results. Please take in account that temp. files in my opinion are problematic for thread safeness. On the other hand big pdfs are problematic for memory consumption. Therefore it was perfect, if one can configure the veraPDF validation engine whether one would have seamless validation by streams (without creation of temp. files) or if one would like to reduce memory usage and therefore allow temp files. Anyway, the temp folder should be configurable in order to respect access right policies (i.e. when used on servers).
Kind regards, Tony
Von: Boris Doubrov [mailto:boris.doubrov@duallab.com] Gesendet: Montag, 6. November 2017 11:05 An: Tony Schaller <tony.schaller@medshare.netmailto:tony.schaller@medshare.net>; users@lists.verapdf.orgmailto:users@lists.verapdf.org Betreff: RE: veraPDF and thread-safeness?
Dear Tony,
The performance and the memory optimization are our primary targets this and the next release. The coming release (1.10) will include a lot of memory optimization and significantly better performance in case of large test documents.
Thread-safeness is in the plans for the next release expected in first quarter of 2018. But if you are interested, we would be able to provide the dev version for tests a bit earlier (end of December or beginning of January).
Best regards, Boris
From: Users [mailto:users-bounces@lists.verapdf.org] On Behalf Of Tony Schaller Sent: Monday, November 6, 2017 10:48 AM To: users@lists.verapdf.orgmailto:users@lists.verapdf.org Subject: Re: [Users] veraPDF and thread-safeness?
Hi all Any advice? Thanks and kind regards, Tony
Von: Tony Schaller Gesendet: Montag, 30. Oktober 2017 15:32 An: 'users@lists.verapdf.org' <users@lists.verapdf.orgmailto:users@lists.verapdf.org> Betreff: veraPDF and thread-safeness?
Hi
We have integrated veraPDF validation-model 1.8.1 from the maven repo (https://mvnrepository.com/artifact/org.verapdf/validation-model) into the eHealth Connector Open Source project (see https://sourceforge.net/projects/ehealthconnector/). See https://sourceforge.net/p/ehealthconnector/wiki/CDA%20Validation/ for more information.
The eHealth Connector supports multithreading, but veraPDF seems not currently to be thread-safe. Is there any plan for a thread-safe veraPDF validation-model?
Thanks in advance for any response.
Regards, Tony
Hi Boris
Thanks a lot for this useful information. I assume that with the mentioned dev version this parameter will be accessible for the API user.
Regards from Switzerland, Tony
Von: Boris Doubrov [mailto:boris.doubrov@duallab.com] Gesendet: Mittwoch, 8. November 2017 11:13 An: Tony Schaller tony.schaller@medshare.net; users@lists.verapdf.org Betreff: RE: veraPDF and thread-safeness?
Hi Tony,
We do have already the functionality of storing temp files (or rather decoded chunks of data) in memory up to a certain limit, and moving them to the temp files above this limit.
At the moment the limit is quite low (10K or so) and is a constant in the code. We’ll open this parameter to the library configuration, so that the user would be able to control this.
Best regards, Boris
From: Tony Schaller [mailto:tony.schaller@medshare.net] Sent: Tuesday, November 7, 2017 11:39 AM To: Boris Doubrov <boris.doubrov@duallab.commailto:boris.doubrov@duallab.com>; users@lists.verapdf.orgmailto:users@lists.verapdf.org Subject: AW: veraPDF and thread-safeness?
Hi Boris
Thanks a lot for your message and your offer! We definitely appreciate a dev version and we therefore also will feed back our test results. Please take in account that temp. files in my opinion are problematic for thread safeness. On the other hand big pdfs are problematic for memory consumption. Therefore it was perfect, if one can configure the veraPDF validation engine whether one would have seamless validation by streams (without creation of temp. files) or if one would like to reduce memory usage and therefore allow temp files. Anyway, the temp folder should be configurable in order to respect access right policies (i.e. when used on servers).
Kind regards, Tony
Von: Boris Doubrov [mailto:boris.doubrov@duallab.com] Gesendet: Montag, 6. November 2017 11:05 An: Tony Schaller <tony.schaller@medshare.netmailto:tony.schaller@medshare.net>; users@lists.verapdf.orgmailto:users@lists.verapdf.org Betreff: RE: veraPDF and thread-safeness?
Dear Tony,
The performance and the memory optimization are our primary targets this and the next release. The coming release (1.10) will include a lot of memory optimization and significantly better performance in case of large test documents.
Thread-safeness is in the plans for the next release expected in first quarter of 2018. But if you are interested, we would be able to provide the dev version for tests a bit earlier (end of December or beginning of January).
Best regards, Boris
From: Users [mailto:users-bounces@lists.verapdf.org] On Behalf Of Tony Schaller Sent: Monday, November 6, 2017 10:48 AM To: users@lists.verapdf.orgmailto:users@lists.verapdf.org Subject: Re: [Users] veraPDF and thread-safeness?
Hi all Any advice? Thanks and kind regards, Tony
Von: Tony Schaller Gesendet: Montag, 30. Oktober 2017 15:32 An: 'users@lists.verapdf.org' <users@lists.verapdf.orgmailto:users@lists.verapdf.org> Betreff: veraPDF and thread-safeness?
Hi
We have integrated veraPDF validation-model 1.8.1 from the maven repo (https://mvnrepository.com/artifact/org.verapdf/validation-model) into the eHealth Connector Open Source project (see https://sourceforge.net/projects/ehealthconnector/). See https://sourceforge.net/p/ehealthconnector/wiki/CDA%20Validation/ for more information.
The eHealth Connector supports multithreading, but veraPDF seems not currently to be thread-safe. Is there any plan for a thread-safe veraPDF validation-model?
Thanks in advance for any response.
Regards, Tony
Hi Boris
Let me come back to the message thread below. We are still interested in integrating veraPDF in the eHealth Connector Open Source Project. When I compare http://verapdf.org/news/ and https://github.com/veraPDF/veraPDF-library/issues/939 then I assume that thread safeness is not given in the current edition of veraPDF, yet. Am I right? If yes, I appreciate a short outlook from your point of view. If no, please indicate me where I can get the promised dev version for our testing.
Thanks and kind regards, Tony
Von: Boris Doubrov [mailto:boris.doubrov@duallab.com] Gesendet: Montag, 6. November 2017 11:05 An: Tony Schaller tony.schaller@medshare.net; users@lists.verapdf.org Betreff: RE: veraPDF and thread-safeness?
Dear Tony,
The performance and the memory optimization are our primary targets this and the next release. The coming release (1.10) will include a lot of memory optimization and significantly better performance in case of large test documents.
Thread-safeness is in the plans for the next release expected in first quarter of 2018. But if you are interested, we would be able to provide the dev version for tests a bit earlier (end of December or beginning of January).
Best regards, Boris
From: Users [mailto:users-bounces@lists.verapdf.org] On Behalf Of Tony Schaller Sent: Monday, November 6, 2017 10:48 AM To: users@lists.verapdf.orgmailto:users@lists.verapdf.org Subject: Re: [Users] veraPDF and thread-safeness?
Hi all Any advice? Thanks and kind regards, Tony
Von: Tony Schaller Gesendet: Montag, 30. Oktober 2017 15:32 An: 'users@lists.verapdf.org' <users@lists.verapdf.orgmailto:users@lists.verapdf.org> Betreff: veraPDF and thread-safeness?
Hi
We have integrated veraPDF validation-model 1.8.1 from the maven repo (https://mvnrepository.com/artifact/org.verapdf/validation-model) into the eHealth Connector Open Source project (see https://sourceforge.net/projects/ehealthconnector/). See https://sourceforge.net/p/ehealthconnector/wiki/CDA%20Validation/ for more information.
The eHealth Connector supports multithreading, but veraPDF seems not currently to be thread-safe. Is there any plan for a thread-safe veraPDF validation-model?
Thanks in advance for any response.
Regards, Tony
Hi Tony,
Parallelization is the key feature we are working right now. It took us a it longer than expected, but we are getting some progress.
We’ve got already a CLI that implements multi-process parallelization. In short, you use the same CLI interface, but indicate in addition how many parallel processes you’d like to run. The combined report for all processes is provided as before. Please let me know if this is something you’d like to test as well?
Multithreading is a bit more tricky, so this might now be available till the end of March.
Best regards, Boris
From: Tony Schaller [mailto:tony.schaller@medshare.net] Sent: Thursday, February 8, 2018 10:23 PM To: Boris Doubrov boris.doubrov@duallab.com; users@lists.verapdf.org Cc: ehc-implementors ehc-implementors@googlegroups.com Subject: AW: veraPDF and thread-safeness?
Hi Boris
Let me come back to the message thread below. We are still interested in integrating veraPDF in the eHealth Connector Open Source Project. When I compare http://verapdf.org/news/ and https://github.com/veraPDF/veraPDF-library/issues/939 then I assume that thread safeness is not given in the current edition of veraPDF, yet. Am I right? If yes, I appreciate a short outlook from your point of view. If no, please indicate me where I can get the promised dev version for our testing.
Thanks and kind regards, Tony
Von: Boris Doubrov [mailto:boris.doubrov@duallab.com] Gesendet: Montag, 6. November 2017 11:05 An: Tony Schaller <tony.schaller@medshare.netmailto:tony.schaller@medshare.net>; users@lists.verapdf.orgmailto:users@lists.verapdf.org Betreff: RE: veraPDF and thread-safeness?
Dear Tony,
The performance and the memory optimization are our primary targets this and the next release. The coming release (1.10) will include a lot of memory optimization and significantly better performance in case of large test documents.
Thread-safeness is in the plans for the next release expected in first quarter of 2018. But if you are interested, we would be able to provide the dev version for tests a bit earlier (end of December or beginning of January).
Best regards, Boris
From: Users [mailto:users-bounces@lists.verapdf.org] On Behalf Of Tony Schaller Sent: Monday, November 6, 2017 10:48 AM To: users@lists.verapdf.orgmailto:users@lists.verapdf.org Subject: Re: [Users] veraPDF and thread-safeness?
Hi all Any advice? Thanks and kind regards, Tony
Von: Tony Schaller Gesendet: Montag, 30. Oktober 2017 15:32 An: 'users@lists.verapdf.org' <users@lists.verapdf.orgmailto:users@lists.verapdf.org> Betreff: veraPDF and thread-safeness?
Hi
We have integrated veraPDF validation-model 1.8.1 from the maven repo (https://mvnrepository.com/artifact/org.verapdf/validation-model) into the eHealth Connector Open Source project (see https://sourceforge.net/projects/ehealthconnector/). See https://sourceforge.net/p/ehealthconnector/wiki/CDA%20Validation/ for more information.
The eHealth Connector supports multithreading, but veraPDF seems not currently to be thread-safe. Is there any plan for a thread-safe veraPDF validation-model?
Thanks in advance for any response.
Regards, Tony
Thanks for this information, Boris! We are currently not in a hurry and CLI does not fit our need. Therefore I’m kindly awaiting the dev release of the thread safe veraPDF version. Regards, Tony
Von: Boris Doubrov [mailto:boris.doubrov@duallab.com] Gesendet: Freitag, 9. Februar 2018 07:47 An: Tony Schaller tony.schaller@medshare.net; users@lists.verapdf.org Cc: ehc-implementors ehc-implementors@googlegroups.com Betreff: RE: veraPDF and thread-safeness?
Hi Tony,
Parallelization is the key feature we are working right now. It took us a it longer than expected, but we are getting some progress.
We’ve got already a CLI that implements multi-process parallelization. In short, you use the same CLI interface, but indicate in addition how many parallel processes you’d like to run. The combined report for all processes is provided as before. Please let me know if this is something you’d like to test as well?
Multithreading is a bit more tricky, so this might now be available till the end of March.
Best regards, Boris
From: Tony Schaller [mailto:tony.schaller@medshare.net] Sent: Thursday, February 8, 2018 10:23 PM To: Boris Doubrov <boris.doubrov@duallab.commailto:boris.doubrov@duallab.com>; users@lists.verapdf.orgmailto:users@lists.verapdf.org Cc: ehc-implementors <ehc-implementors@googlegroups.commailto:ehc-implementors@googlegroups.com> Subject: AW: veraPDF and thread-safeness?
Hi Boris
Let me come back to the message thread below. We are still interested in integrating veraPDF in the eHealth Connector Open Source Project. When I compare http://verapdf.org/news/ and https://github.com/veraPDF/veraPDF-library/issues/939 then I assume that thread safeness is not given in the current edition of veraPDF, yet. Am I right? If yes, I appreciate a short outlook from your point of view. If no, please indicate me where I can get the promised dev version for our testing.
Thanks and kind regards, Tony
Von: Boris Doubrov [mailto:boris.doubrov@duallab.com] Gesendet: Montag, 6. November 2017 11:05 An: Tony Schaller <tony.schaller@medshare.netmailto:tony.schaller@medshare.net>; users@lists.verapdf.orgmailto:users@lists.verapdf.org Betreff: RE: veraPDF and thread-safeness?
Dear Tony,
The performance and the memory optimization are our primary targets this and the next release. The coming release (1.10) will include a lot of memory optimization and significantly better performance in case of large test documents.
Thread-safeness is in the plans for the next release expected in first quarter of 2018. But if you are interested, we would be able to provide the dev version for tests a bit earlier (end of December or beginning of January).
Best regards, Boris
From: Users [mailto:users-bounces@lists.verapdf.org] On Behalf Of Tony Schaller Sent: Monday, November 6, 2017 10:48 AM To: users@lists.verapdf.orgmailto:users@lists.verapdf.org Subject: Re: [Users] veraPDF and thread-safeness?
Hi all Any advice? Thanks and kind regards, Tony
Von: Tony Schaller Gesendet: Montag, 30. Oktober 2017 15:32 An: 'users@lists.verapdf.org' <users@lists.verapdf.orgmailto:users@lists.verapdf.org> Betreff: veraPDF and thread-safeness?
Hi
We have integrated veraPDF validation-model 1.8.1 from the maven repo (https://mvnrepository.com/artifact/org.verapdf/validation-model) into the eHealth Connector Open Source project (see https://sourceforge.net/projects/ehealthconnector/). See https://sourceforge.net/p/ehealthconnector/wiki/CDA%20Validation/ for more information.
The eHealth Connector supports multithreading, but veraPDF seems not currently to be thread-safe. Is there any plan for a thread-safe veraPDF validation-model?
Thanks in advance for any response.
Regards, Tony
users@lists.openpreservation.org
-
Boris Doubrov -
Tony Schaller