Forums

Welcome Guest 

Show/Hide Header

Welcome Guest, posting in this forum requires registration.






Please note that we - the Docear team - will not answer support questions. If you need help, please read the manual, read the FAQ, or discuss here in the forum with other Docear users.

When reporting bugs, or asking questions, please be as specific as possible. Name your operating system (e.g. Windows 7, 64 Bit), your JAVA version (e.g. Java 6, 32 Bit), whether you are using the latest Docear version, and provide step-by-step instructions that allow to reproduce the bug or problem you are reporting. Feel free to upload screenshots.

Due to spammers and the new European GDPR initiative, we decided to deactivate user registrations. This means, only users with an existing account will be able to post in the forum. We are sorry for this but see no other way.
Pages: [1]
Author Topic: Cant Retrieve Google Scholar Metadata
Xenko
Newbie
Posts: 2
Post Cant Retrieve Google Scholar Metadata
on: December 11, 2014, 22:29

I've just installed Docear, and can't get the Google Scholar metadata working.

I put in a PDF, and go to References -> Create or Update Reference. The "Create a new entry and fetch metadata atuomatically" is selected, as well as the title, but I get a "Fetched 0 entries" message below the results window. No matter what I type in the "Search:" field and hit "Lookup", I get 0 results (blank results box). I tried adding the newest library (http://www.docear.org/2014/10/13/update-of-the-google-scholar-pdf-metadata-retrieval/), as well as Steps 1 to 4 in the FAQ (http://www.docear.org/faqs/why-does-metadata-retrieval-from-google-scholar-not-work/) but nothing works. I don't have the ability to change my IP address.

I don't see any options to fill out a captcha, and nothing else happens when I hit search other than a very brief message below the results box (loading icon and some text but it disappears to quick to read) before the "Fetched 0 entries" appears again. I can use Google scholar in the 2 web browsers I have installed (Explorer and Chrome) without any issues, and have tried using it in browser, then back to Docear, but still nothing.

Any ideas? Thanks!

Program Info: Windows 7 Enterprise SP1 64-bit. Docear v 1.1.1 beta build 239

Thank you for your feedback. Please note that we - the Docear team - currently do not have the time to answer support questions. However, we encourage all Docear users to help each other.

kartoffels-
alat
Newbie
Posts: 7
Post Re: Cant Retrieve Google Scholar Metadata
on: December 17, 2014, 11:40

I have the same issue. Tried also everything (delete scholar cookie, reset docear's settings, used new scholar library), but it still does not work.

Scholar works fine with the browser. Furthermore, I did a ping on scholar.google.com at the terminal and this also worked. Interestingly, the pings came back from scholar.l.google.com. Maybe the little l in there is causing all the troubles?

I found an exception in the log message, maybe this is helpful to track down this bug:

STDOUT: scholar.google.comhttp17.12.2014 11:12:10 org.docear.metadata.extractors.GoogleScholarExtractor search
INFO: scholar.google.comhttp
java.net.UnknownHostException: scholar.google.comhttp
	at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:223)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:431)
	at java.net.Socket.connect(Socket.java:527)
	at sun.net.NetworkClient.doConnect(NetworkClient.java:158)
	at sun.net.www.http.HttpClient.openServer(HttpClient.java:424)
	at sun.net.www.http.HttpClient.openServer(HttpClient.java:538)
	at sun.net.www.http.HttpClient.<init>(HttpClient.java:214)
	at sun.net.www.http.HttpClient.New(HttpClient.java:300)
	at sun.net.www.http.HttpClient.New(HttpClient.java:319)
	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:987)
	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:923)
	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:841)
	at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:439)
	at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:424)
	at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:178)
	at org.docear.metadata.extractors.GoogleScholarExtractor.search(GoogleScholarExtractor.java:76)
	at org.docear.metadata.extractors.GoogleScholarExtractor.call(GoogleScholarExtractor.java:243)
	at org.docear.metadata.extractors.GoogleScholarExtractor.call(GoogleScholarExtractor.java:1)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
	at java.lang.Thread.run(Thread.java:695)
17.12.2014 11:12:13 org.freeplane.core.util.LogUtils warn
kartoffels-
alat
Newbie
Posts: 7
Post Re: Cant Retrieve Google Scholar Metadata
on: December 17, 2014, 11:41

Ah, forgot to mention: I'm on a Mac 10.7.5, running Docear 1.1.1, beta build 239.

monkeybeer
Newbie
Posts: 1
Post Re: Cant Retrieve Google Scholar Metadata
on: January 5, 2015, 01:49

Have the same issue, no solution yet.

einhander
Beginner
Posts: 26
Post Re: Cant Retrieve Google Scholar Metadata
on: January 25, 2015, 19:28

I can confirm this issue. I think it's google change something in Scholar.

davcra
Newbie
Posts: 1
Post Re: Cant Retrieve Google Scholar Metadata
on: February 26, 2015, 18:04

I also have this issue on a linux centos machine, java version "1.7.0_71"

John
Newbie
Posts: 2
Post Re: Cant Retrieve Google Scholar Metadata
on: March 2, 2015, 05:26

I started using Docear on February 11th, 2015. Fetch pdf metadata worked for me initially but then stopped. The library update mentioned in the first post got it working again in my case. http://www.docear.org/2014/10/13/update-of-the-google-scholar-pdf-metadata-retrieval/

My system info:
Docear 1.1.1 beta build239
Java 1.8.0_31-b13
Ubuntu 14.04 LTS

einhander
Beginner
Posts: 26
Post Re: Cant Retrieve Google Scholar Metadata
on: April 12, 2015, 20:53

Thank you John for link. It works for me.

Debian Jessie 64 bit, Java 1.8

kartoffels-
alat
Newbie
Posts: 7
Post Re: Cant Retrieve Google Scholar Metadata
on: April 17, 2015, 10:21

This does not work for me. However, I discovered that metadata retrieval works fine if I'm using my WiFi at home, but it stops working if I'm using VPN of my university (Bielefeld, Germany) or the WiFi at the university (Running on a laptop with Fedora 21). So, the internet connection seems to be the problem. I'm happy to provide any further details, since this is actually a quite annoying bug...

zeleznyj
Newbie
Posts: 1
Post Re: Cant Retrieve Google Scholar Metadata
on: July 16, 2015, 12:04

I also have this problem. Deleting cookies or changing the library doesn't help. I only have this problem at my intitute academic network. It seems to work fine at my home network. I can still access google scholar normally from web browser without any captchas. Connecting to a vpn helps, I used this one: http://www.vpngate.net/en/do_openvpn.aspx?fqdn=vpn151341211.opengw.net&ip=89.81.198.82&tcp=1571&udp=1432&sid=1437044134934&hid=438513, but it's not a very practical solution.

Dimand
Newbie
Posts: 2
Post Re: Cant Retrieve Google Scholar Metadata
on: July 21, 2015, 02:55

I also get this bug. It seems to work sometimes. If I put in a small phrase like Docear it returns plenty of results, but any long paper titles are rejected. I have checked incognito windows and there is no captcha on scholar. Using the alternate library does not help.

This is a serious issue for docear as it is one of the best features. This needs to be fixed asap. Contact me if you want full logs or any testing on how this works on my connection. I\'m more than happy to help.

Jul 21, 2015 11:45:14 AM org.freeplane.core.util.LogUtils warn
WARNING: Could not import Xmp Data from File C:\\GoogleDrive\\Documents\\Research\\Papers\\Incoming Lit\\New\\CLEO_QELS-2014-FTh3D.2.pdf

STDOUT: scholar.google.comhttpJul 21, 2015 11:45:15 AM org.docear.metadata.extractors.GoogleScholarExtractor search
INFO: scholar.google.comhttp
java.net.UnknownHostException: scholar.google.comhttp
	at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
	at java.net.PlainSocketImpl.connect(Unknown Source)
	at java.net.SocksSocketImpl.connect(Unknown Source)
	at java.net.Socket.connect(Unknown Source)
	at sun.net.NetworkClient.doConnect(Unknown Source)
	at sun.net.www.http.HttpClient.openServer(Unknown Source)
	at sun.net.www.http.HttpClient.openServer(Unknown Source)
	at sun.net.www.http.HttpClient.<init>(Unknown Source)
	at sun.net.www.http.HttpClient.New(Unknown Source)
	at sun.net.www.http.HttpClient.New(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection$6.run(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection$6.run(Unknown Source)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.security.AccessController.doPrivileged(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(Unknown Source)
	at sun.net.www.protocol.http.HttpURLConnection.connect(Unknown Source)
	at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:439)
	at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:424)
	at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:178)
	at org.docear.metadata.extractors.GoogleScholarExtractor.search(GoogleScholarExtractor.java:76)
	at org.docear.metadata.extractors.GoogleScholarExtractor.call(GoogleScholarExtractor.java:243)
	at org.docear.metadata.extractors.GoogleScholarExtractor.call(GoogleScholarExtractor.java:1)
	at java.util.concurrent.FutureTask.run(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
nadhrahmoh-
dali
Newbie
Posts: 1
Post Re: Cant Retrieve Google Scholar Metadata
on: November 4, 2015, 02:18

Please Help.

I cant seem to get any metadata for the reference.
It works for about 50 pdf, then nothing.

I already replace the google scholar metadata.
http://www.docear.org/2014/10/13/update-of-the-google-scholar-pdf-metadata-retrieval/

Then I try the new version of Docear.
Does not work.

I revert back to the previous version.
I tried most of the solution in http://www.docear.org/faqs/why-does-metadata-retrieval-from-google-scholar-not-work/
the captcha google, replacing the google scholar metadata.

I cant seem to figure out how to change the IP address. But I did connect to the internet using VPN. But still cant retrieve any metadata.

I really like using Docear. Other reference manager is just not as good IMO. Then this happened, I dont know what to do.

Docear 1.1
Java 1.8
Windows 8.1

kartoffels-
alat
Newbie
Posts: 7
Post Re: Cant Retrieve Google Scholar Metadata
on: January 12, 2017, 13:34

I\'ve added a comment to a bug on github with a possible cause of this bug: https://github.com/Docear/Desktop/issues/443#issuecomment-272152242

Pages: [1]
Mingle Forum by cartpauj
Version: 1.0.33.2 ; Page loaded in: 0.171 seconds.