I don't want to put the data in a repository, but I need to sort out what to do with it.
Mar 30, 20213 min read
I don’t want to put the training data for machine learning in a repository to deploy on a server, but what is the best way to do it, I want to organize it.
They were trying to avoid options that could cause problems because they didn’t know if there was a problem or not, and they were afraid of the options that could cause problems.
I realized that since it’s not such a serious problem, I could try it and observe if it happens.
What would you like to see happen in this conversation?
I don’t want to put the training data for machine learning in a repository to deploy on a server, but what is the best way to do it, I want to organize it.
What type of repository is it?
Push to that repository and it will be deployed automatically.
Is there anything else about that repository?
I want to separate the items that are not used on the server, because if I put them in, it might affect transfer time, deployment time, etc.
What type of server is it?
Heroku, you can’t touch the file system directly from here (probably), it’s like a black box.
What kind of Heroku is that Heroku?
NGKW
What type of NGKW is that NGKW?
Huh? (PS: I am surprised that the command is not triggered. Bug: command is not recognized if it is preceded by a space character)
Push to that repository and it will automatically deploy.
Where is this repository located?
This is also on the Heroku server.
Is there anything else about that server?
I’m on the free version anyway, so I guess I’ll sleep, and I don’t want to extend the time it takes to come back from sleep.
What type of sleep is that sleep?
Starts container after user accesses it, so if container is large, it will take longer (probably).
What type of container is it?
I don’t know
Push to that repository and it will automatically deploy.
Where is this repository located?
NG
What type of NG is that NG?
Funny, I thought I fixed this bug, but I checked later (PS: This is also a bug where the command is not recognized if it is preceded by a space character)
What type of bug is it?
NGKW
Push to that repository and it will automatically deploy.
What does this repository look like?
black box
What type of black box is that black box?
You don’t know the details. So you’re worried.
What type of details are those details?
That’s the time it takes to come back from sleep, and since that’s unpredictable, you’re worried about something that could make it worse.
Is there anything else about that sleep?
The ability to tell the user to wait while waiting for recovery from sleep has already been implemented, so should we try it without worrying about it for once, or think about it after the problem occurs?
Where is that sleep?
This page is auto-translated from /nishio/データをリポジトリに置きたくないが、どうするのが良いか整理したい using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I’m very happy to spread my thought to non-Japanese readers.
This is also on the Heroku server.
Is there anything else about that server?