Linking Databases, part 2

Posted in

#76 by Yorhel
2020-03-24 at 14:25
< report >If they only cover (non-doujin) physical releases and they have JAN numbers, then it doesn't even need to be added as a link entry - I can write a crawler to automatically find the appropriate shop links. I'm already doing this for PlayAsia, I'll have a look at Suruga-ya later.

I did try to do this for Amazon as well, but in order to use their products API you need an approved affiliate account. I applied but got rejected. Technically I can scrape the site, but they have protections against that and I'm not willing to waste much time on them.
#77 by skorpiondeath
2020-03-24 at 18:12
< report >Thanks Yorhel.
Amazon... bad guys!
What about having both SubscribeStar and Patreon links for western 3D CG releases?
#78 by Ileca
2020-03-24 at 19:51
< report >Suruga-ya has multiple entries for the same JAN based on how complete the game they are selling is (because it's second hand). Example with Eve Bust Error: link
Also, they have plenty of stuff without a JAN.
link is what they have in stock and link is their internal DB.
A tip for those who want to add old covers: search on link and then use the found ID with link to get the associated cover (hidden if it's out of stock).Last modified on 2020-03-24 at 19:53
#79 by kumiko1
2020-05-13 at 14:27
< report >Re:DMM links, have you looked into becoming a DMM affiliate and handling links that way?
Also I'm surprised Amazon rejected you given how EGS has Amazon affiliate links, I wonder if amazon.co.jp handles them differently.
Suruga-ya links would be nice to have too.
#80 by Yorhel
2020-05-14 at 13:32
< report >I have looked into DMM affiliates but my Japanese is, well, let's not talk about that. I wasn't able to find out if they accepted foreign affiliates in the first place.

A few web searches suggest that Amazon Japan is particularly strict with affiliate registration. It's likely that I'll be able to get through after a few more tries, but I don't really like Amazon enough to spend much effort on that. If they're not enthusiastic about working together, I don't see any reason why I should be.
#81 by gvbn
2020-05-14 at 13:38
< report >DMM affiliate page is region-locked to Japan only
#82 by kumiko1
2020-05-21 at 03:48
< report >Can we get support for adding Twitter links directly to producer pages? I realise you can add them to wikidata but the vast majority of producers don't have wikidata entries and the ones that do tend to have a bunch of subbrands collected into a single entry, it would be very useful to just be able to add them directly. Especially since a lot of producers already have them just in the description anyway.
#83 by Ileca
2020-05-21 at 05:56
< report >You can create new items. To legitimate them, I don't think you need more than:
P31 (instance of): Q210167 (video game developer) | Q5 (human),
P749: (parent organization), in case of sub-brands.
Flesh them a little with P106 (occupation) in case of a person, enough to make them "notable".
DON'T FORGET P3180 VISUAL NOVEL DATABASE ID DUUH
Though, it is a pita, indeed.

If you want to add more stuff, take example on pages I filled: Active and Seishoujo.
#84 by kumiko1
2020-09-21 at 04:00
< report >Shouldn't we have links to Google Play and the App Store for mobile VNs?
#85 by Ileca
2020-09-24 at 22:56
< report >What about https://www.freem.ne.jp link?
There are 3494 "novel games" on it. It could even push someone to actually add all those missing games to vndb.Last modified on 2020-09-24 at 22:56
#86 by rampaa
2020-10-03 at 14:50
< report >Would it be possible to have "related manga" and "related novel" fields for VNs, just like the "related anime" field we have?

Some useful links
For manga: link, link, link, link, link, link
For novels: link, link, link, link, link, link
#87 by Yorhel
2020-10-03 at 15:23
< report >@86: My biggest annoyance is that for other media (except anime) there's (to my knowledge) no database that is both comprehensive and links other related databases together. So we can't handle this like anime relations where we can restrict the input to a single identifier and everything else will be fetched automatically.

Also related: non-vn game relations. I see I ranted about the same thing recently at t14405, heh. Beliar's solution is what we'll have to go for, but it's meh.
#88 by trickzzter
2020-10-10 at 05:49
< report >I too would like to see links to Google Play, App Store and Freem. There are quite a lot of VNs on these "stores".
#89 by blahblah35
2020-11-18 at 17:06
< report >I don't know about Google Play and App Store, but I encoutered Freem few times already, which seems to be an itch.io like, and I think that it could be useful.
#90 by Yorhel
2020-12-14 at 13:25
< report >Bunch more links added: Google Play, App Store, Freem and Animate Games (t15179). "Official website" links have been automatically converted to the new fields.
#91 by kumiko1
2020-12-15 at 07:29
< report >Great, thanks

Are region-locked App Store links broken for anyone else? link works fine but vndb gives me link which doesn't load.

Also any chance we could get sofmap link and traders link too please?
#92 by Yorhel
2020-12-15 at 10:24
< report >
Are region-locked App Store links broken for anyone else?
Ugh. That must be why Wikidata calls it (global). Yeah, region-locked links aren't going to work and will have to go back to the website field or notes. No clue how many are affected.
#93 by gvbn
2021-02-19 at 10:14
< report >Toranoana all-ages links (ecs. instead of ec.) aren't being recognized for .jp

E.g. link is not recognized

Redirection via ec. + .shop works, e.g. link

Also the URL example for Toranoana says <com or jp> even though .com seems to be some yakiniku restaurant.Last modified on 2021-02-19 at 10:15
#94 by Yorhel
2021-02-19 at 10:29
< report >Both fixed.
#95 by gvbn
2021-03-16 at 00:16
< report >DLsite English has been merged with the Japanese site (link) and the old RE links now just redirect to RJ pages.
#96 by Yorhel
2021-03-16 at 07:38
< report >I've converted all entries that had a link to DLsite English but not to the regular DLsite and the DLsite English links aren't displayed anymore.

I also found a few games that have different RJ-codes for the EN and JP versions, but with this change we can only have a single DLsite link. Haven't looked deeper into this yet, so not sure if/how we should handle that. DLsite itself already lets you switch easily between languages now, so a single link is probably fine.
#97 by foiegras
2021-03-25 at 07:21
< report >I wrote a script to add more erogamescape links, mainly by replacing full-width characters to regular ones and giving a margin of error to the title comparison. Release dates are checked.

The data is here. The links look good, thought the title comparison can create mistakes with prequels/sequels having the same release date like Summer Radish Vacation!! and Summer Radish Vacation!! 2.
Should I try to add more checks?
#98 by Yorhel
2021-03-25 at 08:04
< report >Having related VNs on the same day doesn't sound too common, so if there's not too many examples of that we can easily fix that afterwards.
Would it make sense and is it possible to also match platforms? e.g. F Fanatic gets the same EGS id for PS2 and Windows, is that correct? I don't have a proxy ready to check...
#99 by foiegras
2021-03-27 at 06:56
< report >There are two entries on EGS for F Fanatic, so one of the link is incorrect.

I checked how many releases are affected by the VN relation and the platform issue. I created those queries: link and link. It's about 700 releases with VN relation, and 1700 with different platforms. Thought the queries aren't perfect. I expect the release count affected by the VN relation issue to be lower as titles are often quite different.

It is possible to match platforms, EGS provides a field for it. I will try adding them in my script.
#100 by foiegras
2021-03-27 at 18:40
< report >Alright, I added some platform checks. I also made a few improvements to the script to avoid some duplicated entries in the output. Releases with a Latin original title were excluded in the previous version, now there are included.

The new data is here. There are actually more entries than before, it's due to releases with a Latin original title.
The issue with F Fanatic is solved, thought the list may still contain some errors.