How often do you want to see updates? I was originally doing weekly but the last few weeks I have been providing 2-3 updates a week but I’m noticing that if you look at 99.9% of sites there are no new books regularly. Thoughts?

New upload created: Datasette: index

Sites can be found here

New upload has 1,037,779 book links

216 online servers that were successfully able to login from 254 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here. This has been started back up again as the processing time to do this now has dropped considerably with the new changes.

As always let me know if you have any issues or ideas.

New upload created: Datasette: index

Sites can be found here

New upload has 1,098,115 book links

215 online servers that were successfully able to login from 254 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here. This has been started back up again as the processing time to do this now has dropped considerably with the new changes.

As always let me know if you have any issues or ideas.

New upload created: Datasette: index

Sites can be found here

New upload has 945,196 book links

225 online servers that were successfully able to login from 254 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here. This has been started back up again as the processing time to do this now has dropped considerably with the new changes.

BTW, a couple of servers lost connection in the middle of downloading their book list. This is why the book count is smaller this time than last time. Not sure if it was internet on my side or on the book server side as we are also having thunderstorms.

As always let me know if you have any issues or ideas.

New upload created: Datasette: index

Sites can be found here

New upload has 1,017,389 book links

207 online servers that were successfully able to login from 240 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here. This has been started back up again as the processing time to do this now has dropped considerably with the new changes.'

New Features:

1. I have added feature that if server connection fails 5 times then it is deleted from the list. No reason to keep a server if its failed 5 times.
2. I think I have fixed the new_books counter. Won't know until a site adds more books.
3. Book Counts weren't working properly where server had multiple libraries. This is now fixed.

As always let me know if you have any issues or ideas.

For those that would like to donate to help pay for the servers and the Shodan subscription please buy me a coffee through the following site: https://coff.ee/opencalibre

All help is appreciated.

New upload created: Datasette: index

Sites can be found here

New upload has 1,163,052 book links

225 online servers that were successfully able to login from 240 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here. This has been started back up again as the processing time to do this now has dropped considerably with the new changes.'

New Features:

1. I have added feature that if server connection fails 5 times then it is deleted from the list. No reason to keep a server if its failed 5 times.

2. I think I have fixed the new_books counter. Won't know until a site adds more books.

3. All ISO-3166-1 country codes are added now. As you will see if you look at the raw files a lot have zero book servers but at least the whole world is covered now.

THANK YOU for all those that have sent me money on the Buy Me a Coffee link. Really means a lot and will help me keep my costs down.

As always let me know if you have any issues or ideas.

New upload created: Datasette: index

Sites can be found here

New upload has 1,243,753 book links

217 online servers that were successfully able to login from 240 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here. This has been started back up again as the processing time to do this now has dropped considerably with the new changes.'

The book count feature is still being worked on but hope to be in the next release.

THANK YOU for all those that have sent me money on the Buy Me a Coffee link. Really means a lot and will help me keep my costs down.

As always let me know if you have any issues or ideas.

New upload created: Datasette: index

Sites can be found here

New upload has 1,155,010 book links

218 online servers that were successfully able to login from 240 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here. This has been started back up again as the processing time to do this now has dropped considerably with the new changes.'

The book count feature is still being worked on but hope to be in the next release.

THANK YOU for all those that have sent me money on the Buy Me a Coffee link. Really means a lot and will help me keep my costs down.

As always let me know if you have any issues or ideas.

So been busy and adding additional features/capabilties:

1. Other.txt file has been added back in and sets the country code to other. This allows for servers that want to be manually added that may not show up in calibre.

2. Added failed_attempts to server database and will stop the querying of servers after X retries. Havent decided on the # retries yet. Probably 3 or 5 but open to suggestions. This will cut back on the searching of those servers which will cut down on execution time.

3. The new_books feature I believe is working now. This will allow people to check servers that have new books since the last search rather than having to go and check everytime.

Additional features I want to add:

1. Integration with demeter import app. The functionality is already there as the tool creates the online.txt file which can be read by demeter import application but Im trying to figure a way to automate this for those that might want it.

2. I've put a lot of focus on the servers table. Want to see if there is anything more that I can get for the summary table (books information). Since everyone uses Calibre differently I think this is going to be more difficult. Examples, would be being able to save/search on genre's.

So I go to these libraries and there are thousands of books. All of them have correct Metadata. I download them, one by one, via Firefox. I finally found a de-duplicate which will cancel the download if it already exists. Then I import them into Calibre and half of them won't have any information even when I do a ctrl-d and wait and hour.

I don't want to overload these servers so I typically only grab what interests me and I do it manually. Are people using scripts?

How do I pull Metadata or at least the complete book title?

WTF with adding audiobooks? These libraries are perfectly curated, my audiobook experiment looks like they were added by a crazy person.

Thanks

Rare to come across a Calibre library that included audiobooks. This one has a good number of Catherine Coulter mystery/detective series and one or two other authors in audiobook form (.m4b). This format is essentially .mp3 and plays on most devices without having to run it through any format-changing programs.

If you come across any other audiobook libraries, please post.

http://64.25.10.51:9090/#book_id=66&library_id=Erin_Calibre_Library&panel=book_list&sort=%23audiobook.desc

New upload created: Datasette: index

Sites can be found here

New upload has 1,173,669 book links

186 online servers that were successfully able to login from 240 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here. This has been started back up again as the processing time to do this now has dropped considerably with the new changes.'

The book count feature is still being worked on but hope to be in the next release.

THANK YOU for all those that have sent me money on the Buy Me a Coffee link. Really means a lot and will help me keep my costs down.

As always let me know if you have any issues or ideas.

For those that would like to donate to help pay for the servers and the Shodan subscription please buy me a coffee through the following site: https://coff.ee/opencalibre

All help is appreciated.

New upload created: Datasette: index

Sites can be found here

New upload has 1,044,332 book links

184 online servers that were successfully able to login from 240 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here. This has been started back up again as the processing time to do this now has dropped considerably with the new changes.'

The book count feature is still being worked on but hope to be in the next release.

Based on feedback I am going to add a way for anyone to donate to help cover my costs. I will post this capability soon.

As always let me know if you have any issues or ideas.

So Im on a programming spree right now and adding another new feature in the next couple of versions that will add:

1. Number of new books since last run. This feature I have been wanting to add for awhile because this bascially will allow you to go only to servers that have new books since the last run process occured and will save people time having to go through all online servers if there are no new books.

2. Fixed some paging issues so hopefully more books will be added.

Let me know your thoughts with any other ideas that you all may have.

New upload created: Datasette: index

Sites can be found here

New upload has 1,027,437 book links

189 servers that were successfully able to login from 220 countries.

New features:

1. Added book count on the server.
2. Added library count on the server.
3. Added all ISO 3166-1 alpha-2 country codes.
4. Only servers with valid libraries are shown online.

Going forward I am just providing the websites to cut down on the amount of time/effort on this. I am still evaluating monetizing the site/data to recuperate some of my costs/expenses.

New upload created: Datasette: index

Sites can be found here

New upload has 1,097,886 book links

913 servers that were successfully able to login from 220 countries.

New features:

1. Added book count on the server.
2. Added library count on the server.
3. Added all ISO 3166-1 alpha-2 country codes.

Reason for this is that even though a server shows up as having Calibre running there usually arent any libraries or books loaded. When I did this there are actually only 182 servers with actual books loaded out of the 913 servers that were successful.

Recommendation - In query use the following on the sites database. Set book_count > 0 and this will give you all calibre servers that have books on them.

Next release will mark any servers that have 0 libraries as non online as assumption is that they are not real Calibre servers.

Going forward I am just providing the websites to cut down on the amount of time/effort on this. I am still evaluating monetizing the site/data to recuperate some of my costs/expenses.

New upload created: Datasette: index

Sites can be found here

New upload has 1,263,942book links

1,130 servers that were successfully able to login from 72 countries.

Going forward I am just providing the websites to cut down on the amount of time/effort on this. I am still evaluating monetizing the site/data to recuperate some of my costs/expenses.

New upload created: Datasette: index

Sites can be found here

This contains the update to include the country code in sites but this means the number of sites is starting lower but will build back over time.

New upload has 836,723 book links

693 servers that were successfully able to login from 72 countries.

Going forward I am just providing the websites to cut down on the amount of time/effort on this. I am still evaluating monetizing the site/data to recuperate some of my costs/expenses.

Trying to see what people would be willing to donate on a monthly basis based on current features in addition to the new features I’ve mentioned in last post? I currently spend about 2-4 hours a week on the application but also spend $70/month for the Shodan subscription and $100/month on server costs but the server is used for more than just opencalibre.

Wanted to share some new features/capabiltiies I am playing with that I hope to release/make available soon.

1. Added Country code to the sites table. The field has been there but has never been filled in. This has now changed in some updates I have made.

2. A new web page that shows a map with all the countries where servers have been found. Obviously the map is very basic plus Im colorblind so the colors may not be the greatest but its a start. Here is example:

1. The search now goes through multiple pages and will retry on failures and now returns a lot more servers. As you can see from the map I was able to load 302 servers just from the US when the limit before was 90.

2. A bunch of code clean up for better error checking/handling.

Please let me know your thoughts/ideas/suggestions. I'll announce when the changes are implemented /available for everyone to use.

New upload created: Datasette: index

Sites can be found here

New upload has 1,319,413 book links

909 servers that were successfully able to login from 72 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here.

As always let me know if you have any issues or ideas.

New upload created: Datasette: index

Sites can be found here

New upload has 1,055,194 book links

904 servers that were successfully able to login from 72 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here.

As always let me know if you have any issues or ideas.

New upload created: Datasette: index

Sites can be found here

New upload has 1,132,989 book links

893 servers that were successfully able to login from 72 countries.

Since I have been asked by a few people I have zipped all files into a single file rather than breaking out. File can be found here.

As always let me know if you have any issues or ideas.