Forums

Welcome Guest 

Show/Hide Header

Welcome Guest, posting in this forum requires registration.






Please note that we - the Docear team - will not answer support questions. If you need help, please read the manual, read the FAQ, or discuss here in the forum with other Docear users.

When reporting bugs, or asking questions, please be as specific as possible. Name your operating system (e.g. Windows 7, 64 Bit), your JAVA version (e.g. Java 6, 32 Bit), whether you are using the latest Docear version, and provide step-by-step instructions that allow to reproduce the bug or problem you are reporting. Feel free to upload screenshots.

Due to spammers and the new European GDPR initiative, we decided to deactivate user registrations. This means, only users with an existing account will be able to post in the forum. We are sorry for this but see no other way.
Pages: [1]
Author Topic: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
janewaite
Newbie
Posts: 16
Post Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: September 24, 2017, 16:29

I do hope someone can help me.

Suddenly with no warning the create or update reference no longer retrieves data on the fetch metadata automatically. It does not say no items retrieved, instead the finished 0 of 1 request just spins the circle. Before I had problems with this and used hideme and this seemed to allow me to automatically access google scholar through this function.
I have tried hideme - and it makes no difference.

I have invested a huge amount of time and effort in creating my PhD bibilography in docear. I will be very sad if I can now no longer use it.

Huge hope that someone can help. I will pay!!

I attach a log file from today.

Kind regards Jane

Thank you for your feedback. Please note that we - the Docear team - currently do not have the time to answer support questions. However, we encourage all Docear users to help each other.

Joeran-
[Docear]
Administrator
Posts: 656
Post Re: Create or Update reference - has stopped working
on: October 1, 2017, 17:28

Google Scholar recently changed its web design and it seems that our parser cannot fetch the metadata anymore from that new website layout. we would have to adjust the parser to be able to cope with the new layout, but unfortunately, we don\'t have the time for that.

maybe some user of docear, who has good programming skills, is willing to do the work? if so, let me know. I would happily update the current version of Docear on our website.

Joeran-
[Docear]
Administrator
Posts: 656
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: October 1, 2017, 17:30

Just to clarify: you can still manually create references. Actually, you can e.g. copy and paste the BibTeX code from Google Scholar. Of course, it\'s not as comfortable as having it completely automatic, but it takes typically less than 10 seconds per document.

silberzwie-
bel
Newbie
Posts: 5
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: October 2, 2017, 13:47

I fixed the metadata retrieval in https://github.com/Docear/Desktop/pull/506
If there is a future for docear, however, I\'d highly suggest to find a more reliable way to do this (some ideas noted in the pull request).

silberzwie-
bel
Newbie
Posts: 5
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: October 2, 2017, 13:52

@janewaite: you can follow the instructions on blogpost [1] with the file [2]

[1] http://www.docear.org/2014/10/13/update-of-the-google-scholar-pdf-metadata-retrieval/
[2] https://github.com/silberzwiebel/Docear/raw/master/docear_plugin_bibtex/lib/docear-metadata-lib-0.0.1.jar

Joeran-
[Docear]
Administrator
Posts: 656
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: October 5, 2017, 10:46

thank you very much!

Update for Docear’s “Google Scholar Parser” Library to Fetch Metadata for PDF files

mjonian
Newbie
Posts: 4
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: January 4, 2018, 09:10

Hi there,

I\'m trying to use this workaround in MacOS High Sierra and it\'s not working. Any experience or any idea of what can I do?

Thanks in advance,

mjonian

silberzwie-
bel
Newbie
Posts: 5
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: January 4, 2018, 12:41

Hi mjonian,

I kind of could reproduce your issue. At least it neither works for me anylonger under macOS Sierra. I tried to fix it but this time it seems to be an issue with Google scholar\'s SSL certificates that somehow are not accepted under macOS (it still works under Fedora linux).
Unfortunately, I neither have the time nor the (time to gain) expertise in solving this soon.

In general, it always helps to provide log files, if an error happens (be sure to enable debug logging for the metatdata search first!). Under macOS, the latest log can be found at the location /Users/username/.docear/logs/log.0

If there is anyone out there who has experience with proper implementing a JSoup Https connection, please step up (relevant code is in https://github.com/Docear/Desktop/blob/master/docear_metadata/src/main/java/org/docear/metadata/extractors/HtmlDataExtractor.java and https://github.com/Docear/Desktop/blob/master/docear_metadata/src/main/java/org/docear/metadata/extractors/GoogleScholarExtractor.java ). Here is the exception that I got: https://gist.github.com/silberzwiebel/0740acd03aa39316db17fd5a21d7d409

Best,
silberzwiebel

mjonian
Newbie
Posts: 4
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: January 4, 2018, 13:42

Hi again,

Sad to hear bad news... Any case, the error I got is the following one:

STDOUT: java.lang.RuntimeException: Unexpected error: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty04-ene-2018 13:36:40 org.docear.metadata.extractors.GoogleScholarExtractor search
INFO: java.lang.RuntimeException: Unexpected error: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty
javax.net.ssl.SSLException: java.lang.RuntimeException: Unexpected error: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty
at com.sun.net.ssl.internal.ssl.Alerts.getSSLException(Alerts.java:190)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1747)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1708)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.handleException(SSLSocketImpl.java:1691)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1222)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1199)
at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:476)
at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:166)
at sun.net.www.protocol.https.HttpsURLConnectionImpl.connect(HttpsURLConnectionImpl.java:133)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:439)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:465)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:424)
at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:178)
at org.docear.metadata.extractors.GoogleScholarExtractor.search(GoogleScholarExtractor.java:64)
at org.docear.metadata.extractors.GoogleScholarExtractor.call(GoogleScholarExtractor.java:377)
at org.docear.metadata.extractors.GoogleScholarExtractor.call(GoogleScholarExtractor.java:1)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:695)
Caused by: java.lang.RuntimeException: Unexpected error: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty
at sun.security.validator.PKIXValidator.<init>(PKIXValidator.java:57)
at sun.security.validator.Validator.getInstance(Validator.java:161)
at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.getValidator(X509TrustManagerImpl.java:108)
at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:204)
at com.sun.net.ssl.internal.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:249)
at com.sun.net.ssl.internal.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1188)
at com.sun.net.ssl.internal.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:135)
at com.sun.net.ssl.internal.ssl.Handshaker.processLoop(Handshaker.java:593)
at com.sun.net.ssl.internal.ssl.Handshaker.process_record(Handshaker.java:529)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:943)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1188)
at com.sun.net.ssl.internal.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1215)
... 16 more
Caused by: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty
at java.security.cert.PKIXParameters.setTrustAnchors(PKIXParameters.java:183)
at java.security.cert.PKIXParameters.<init>(PKIXParameters.java:103)
at java.security.cert.PKIXBuilderParameters.<init>(PKIXBuilderParameters.java:87)
at sun.security.validator.PKIXValidator.<init>(PKIXValidator.java:55)
... 27 more
04-ene-2018 13:36:46 org.freeplane.core.util.LogUtils info

If somebody knows how to solve this issue I would appreciate it a lot.

Best regards,

mjonian

silberzwie-
bel
Newbie
Posts: 5
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: January 4, 2018, 14:35

Your error might be fixed with an update of your Java. And / or have a look at this blogpost: http://architecturalatrocities.com/post/19073788679/fixing-the-trustanchors-problem-when-running

You might run into a different error then.

mjonian
Newbie
Posts: 4
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: January 5, 2018, 09:30

I\'ve tried your suggestions and no result, even using this https://www.docear.org/faqs/how-to-run-docear-under-macos-10-11-el-capitan-and-java-8/

I\'m totally stuck at the moment...

mjonian
Newbie
Posts: 4
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: January 8, 2018, 14:43

Hi again,

The error you got is similar to this one?

STDOUT: java.security.cert.CertificateException: No subject alternative DNS name matching scholar.google.com found.08-ene-2018 14:39:41 org.docear.metadata.extractors.GoogleScholarExtractor search
INFO: java.security.cert.CertificateException: No subject alternative DNS name matching scholar.google.com found.
javax.net.ssl.SSLHandshakeException: java.security.cert.CertificateException: No subject alternative DNS name matching scholar.google.com found.

silberzwie-
bel
Newbie
Posts: 5
Post Re: Create or Update reference (Fetching PDF metadata from Google Scholar) - has stopped working
on: January 8, 2018, 14:46

Hi,

yes, that\\\'s the same error I get under macOS, for my whole error message see here: https://gist.github.com/silberzwiebel/0740acd03aa39316db17fd5a21d7d409

Good luck!

Pages: [1]
Mingle Forum by cartpauj
Version: 1.0.33.2 ; Page loaded in: 0.128 seconds.