Linking Databases, part 2
|#76 by yorhel|
2020-03-24 at 14:25
|< report >If they only cover (non-doujin) physical releases and they have JAN numbers, then it doesn't even need to be added as a link entry - I can write a crawler to automatically find the appropriate shop links. I'm already doing this for PlayAsia, I'll have a look at Suruga-ya later.|
I did try to do this for Amazon as well, but in order to use their products API you need an approved affiliate account. I applied but got rejected. Technically I can scrape the site, but they have protections against that and I'm not willing to waste much time on them.
|#77 by skorpiondeath|
2020-03-24 at 18:12
|< report >Thanks Yorhel. |
Amazon... bad guys!
What about having both SubscribeStar and Patreon links for western 3D CG releases?
|#78 by eacil|
2020-03-24 at 19:51
|< report >Suruga-ya has multiple entries for the same JAN based on how complete the game they are selling is (because it's second hand). Example with Eve Bust Error: link|
Also, they have plenty of stuff without a JAN.
link is what they have in stock and link is their internal DB.
A tip for those who want to add old covers: search on link and then use the found ID with link to get the associated cover (hidden if it's out of stock).Last modified on 2020-03-24 at 19:53
|#79 by kumiko1|
2020-05-13 at 14:27
|< report >Re:DMM links, have you looked into becoming a DMM affiliate and handling links that way?|
Also I'm surprised Amazon rejected you given how EGS has Amazon affiliate links, I wonder if amazon.co.jp handles them differently.
Suruga-ya links would be nice to have too.
|#80 by yorhel|
2020-05-14 at 13:32
|< report >I have looked into DMM affiliates but my Japanese is, well, let's not talk about that. I wasn't able to find out if they accepted foreign affiliates in the first place.|
A few web searches suggest that Amazon Japan is particularly strict with affiliate registration. It's likely that I'll be able to get through after a few more tries, but I don't really like Amazon enough to spend much effort on that. If they're not enthusiastic about working together, I don't see any reason why I should be.
|#81 by gvbn|
2020-05-14 at 13:38
|< report >DMM affiliate page is region-locked to Japan only|
|#82 by kumiko1|
2020-05-21 at 03:48
|< report >Can we get support for adding Twitter links directly to producer pages? I realise you can add them to wikidata but the vast majority of producers don't have wikidata entries and the ones that do tend to have a bunch of subbrands collected into a single entry, it would be very useful to just be able to add them directly. Especially since a lot of producers already have them just in the description anyway.|
|#83 by eacil|
2020-05-21 at 05:56
|< report >You can create new items. To legitimate them, I don't think you need more than:|
P31 (instance of): Q210167 (video game developer) | Q5 (human),
P749: (parent organization), in case of sub-brands.
Flesh them a little with P106 (occupation) in case of a person, enough to make them "notable".
DON'T FORGET P3180 VISUAL NOVEL DATABASE ID DUUH
Though, it is a pita, indeed.
If you want to add more stuff, take example on pages I filled: Active and Seishoujo.
|#84 by kumiko1|
2020-09-21 at 04:00
|< report >Shouldn't we have links to Google Play and the App Store for mobile VNs?|
|#85 by eacil|
2020-09-24 at 22:56
|< report >What about https://www.freem.ne.jp link?|
There are 3494 "novel games" on it. It could even push someone to actually add all those missing games to vndb.Last modified on 2020-09-24 at 22:56
|#86 by rampaa|
2020-10-03 at 14:50
|< report >Would it be possible to have "related manga" and "related novel" fields for VNs, just like the "related anime" field we have?|
Some useful links
For manga: link, link, link, link, link, link
For novels: link, link, link, link, link, link
|#87 by yorhel|
2020-10-03 at 15:23
|< report >@86: My biggest annoyance is that for other media (except anime) there's (to my knowledge) no database that is both comprehensive and links other related databases together. So we can't handle this like anime relations where we can restrict the input to a single identifier and everything else will be fetched automatically.|
Also related: non-vn game relations. I see I ranted about the same thing recently at t14405, heh. Beliar's solution is what we'll have to go for, but it's meh.
|#88 by trickzzter|
2020-10-10 at 05:49
|< report >I too would like to see links to Google Play, App Store and Freem. There are quite a lot of VNs on these "stores".|
|#89 by blahblah35|
2020-11-18 at 17:06
|< report >I don't know about Google Play and App Store, but I encoutered Freem few times already, which seems to be an itch.io like, and I think that it could be useful.|
|#90 by yorhel|
2020-12-14 at 13:25
|< report >Bunch more links added: Google Play, App Store, Freem and Animate Games (t15179). "Official website" links have been automatically converted to the new fields.|
|#91 by kumiko1|
2020-12-15 at 07:29
|< report >Great, thanks|
Are region-locked App Store links broken for anyone else? link works fine but vndb gives me link which doesn't load.
Also any chance we could get sofmap link and traders link too please?
|#92 by yorhel|
2020-12-15 at 10:24
|< report >|
Are region-locked App Store links broken for anyone else?Ugh. That must be why Wikidata calls it (global). Yeah, region-locked links aren't going to work and will have to go back to the website field or notes. No clue how many are affected.
|#93 by gvbn|
2021-02-19 at 10:14
|< report >Toranoana all-ages links (ecs. instead of ec.) aren't being recognized for .jp|
E.g. link is not recognized
Redirection via ec. + .shop works, e.g. link
Also the URL example for Toranoana says <com or jp> even though .com seems to be some yakiniku restaurant.Last modified on 2021-02-19 at 10:15
|#94 by yorhel|
2021-02-19 at 10:29
|< report >Both fixed.|
|#95 by gvbn|
2021-03-16 at 00:16
|< report >DLsite English has been merged with the Japanese site (link) and the old RE links now just redirect to RJ pages.|
|#96 by yorhel|
2021-03-16 at 07:38
|< report >I've converted all entries that had a link to DLsite English but not to the regular DLsite and the DLsite English links aren't displayed anymore.|
I also found a few games that have different RJ-codes for the EN and JP versions, but with this change we can only have a single DLsite link. Haven't looked deeper into this yet, so not sure if/how we should handle that. DLsite itself already lets you switch easily between languages now, so a single link is probably fine.
|#97 by foiegras|
2021-03-25 at 07:21
|< report >I wrote a script to add more erogamescape links, mainly by replacing full-width characters to regular ones and giving a margin of error to the title comparison. Release dates are checked.|
The data is here. The links look good, thought the title comparison can create mistakes with prequels/sequels having the same release date like Summer Radish Vacation!! and Summer Radish Vacation!! 2.
Should I try to add more checks?
|#98 by yorhel|
2021-03-25 at 08:04
|< report >Having related VNs on the same day doesn't sound too common, so if there's not too many examples of that we can easily fix that afterwards.|
Would it make sense and is it possible to also match platforms? e.g. F Fanatic gets the same EGS id for PS2 and Windows, is that correct? I don't have a proxy ready to check...
|#99 by foiegras|
2021-03-27 at 06:56
|< report >There are two entries on EGS for F Fanatic, so one of the link is incorrect.|
I checked how many releases are affected by the VN relation and the platform issue. I created those queries: link and link. It's about 700 releases with VN relation, and 1700 with different platforms. Thought the queries aren't perfect. I expect the release count affected by the VN relation issue to be lower as titles are often quite different.
It is possible to match platforms, EGS provides a field for it. I will try adding them in my script.
|#100 by foiegras|
2021-03-27 at 18:40
|< report >Alright, I added some platform checks. I also made a few improvements to the script to avoid some duplicated entries in the output. Releases with a Latin original title were excluded in the previous version, now there are included.|
The new data is here. There are actually more entries than before, it's due to releases with a Latin original title.
The issue with F Fanatic is solved, thought the list may still contain some errors.