Having worked quite a lot the past few days, it's time to make another post on the progress.
I continued on the system and tackled the worker.
Next to that I moved my project from bitbucket to github.
The DMTCP and job files required on the basic CBAS ami are fixed as well.
The first jobs have run and the first checkpoints are created.
Plenty of bugfixes were required, and I have inserted the restarting functionality today.
This still needs to be tested a bit more thoroughly.
Afterwards we can start with the main part of this internship : combining our system with something to aid us in the decision of bid price and instance type.
Currently this is implemented using the on demand EC2 system.
Some other things that require additional thought:
- Cleaning of the buckets at some time.
- Making the master more robust.
- Clean the SNS topic of unused HTTP endpoints, this could even become a security issue.
Geen opmerkingen:
Een reactie posten