piwigo
/
PiwigoDirectoryUploader
2
0
Fork 0
Code Issues 3 Pull Requests Releases Wiki Activity
187 Commits 2 Branches 2 Tags 23 MiB
Commit Graph

146 Commits

Author SHA1 Message Date
Philipp Häfelfinger bd5250f0d5 moved datastore in own internal package 2019-04-02 21:30:39 +02:00
Philipp Häfelfinger 582b0621c2 sorted image list that will be uploaded 2019-03-27 00:28:07 +01:00
Philipp Häfelfinger 86e26b1bb5 switched order. delete before upload 2019-03-25 23:40:28 +01:00
Philipp Häfelfinger f2d83e57ea optimized metadata create / update performance 2019-03-25 23:36:25 +01:00
Philipp Häfelfinger 2e1c2c4e61 fixed logoutput 2019-03-25 22:54:30 +01:00
Philipp Häfelfinger 8a361fff3c added test to remove unneeded updates if a file is not found on the server 2019-03-25 22:40:19 +01:00
Philipp Häfelfinger e57fe635c2 fixed handling of upload required if there is no piwigo id 2019-03-25 00:09:56 +01:00
Philipp Häfelfinger 435af4b591 added flag to enable image removal 2019-03-24 23:58:35 +01:00
Philipp Häfelfinger 5896670c87 added delete images 2019-03-24 23:54:50 +01:00
Philipp Häfelfinger b52393feaa added DeleteMarkedImages to the local datastore 2019-03-24 23:44:16 +01:00
Philipp Häfelfinger 2c65c5827e added DeleteImages to the piwigo context 2019-03-24 23:07:59 +01:00
Philipp Häfelfinger df349a85e6 added implementation for synchronizeLocalImageMetadataFindFilesToDelete 
added test synchronizeLocalImageMetadataFindFilesToDelete
updated usage of entry and leave debug messages of the functions
 2019-03-24 00:10:07 +01:00
Philipp Häfelfinger c4e33598e9 added ImageMetadataAll 2019-03-23 23:56:35 +01:00
Philipp Häfelfinger 0d9579534d moved the filesystem scan to a own function 2019-03-23 23:33:44 +01:00
Philipp Häfelfinger 560f5057ac added ImageMetadataToDelete to the datastore 
added test if it selectes the records to delete
added todo to refactor some image tests to use the generated mocks
 2019-03-23 23:21:35 +01:00
Philipp Häfelfinger 5503a429c3 fixed namings and inlined som variables 2019-03-23 23:14:16 +01:00
Philipp Häfelfinger 4aae22527c introduced deferred cleanup calls 
added test to ensure only files not to delete are part of the to upload list
fixed red test
 2019-03-23 23:08:08 +01:00
Philipp Häfelfinger 54bc3d603c automatic codeformat 2019-03-23 23:05:40 +01:00
Philipp Häfelfinger 5cb044d4b7 added deleteRequired to the database 2019-03-23 22:54:31 +01:00
Philipp Häfelfinger cc2656cb09 updated copyright notice at the top of the files 2019-03-23 22:41:04 +01:00
Philipp Häfelfinger 9ab0ddb2d0 updated copyright notice at the top of the files 2019-03-23 22:40:56 +01:00
Philipp Häfelfinger 21a3e08478 added tests for the filescanner using a testimage 2019-03-23 22:05:25 +01:00
Philipp Häfelfinger 8efd309a9c added some tests to the image code 2019-03-23 21:35:16 +01:00
Philipp Häfelfinger c9b6a7e6db learned about mocking and made mocks work 
added new tests for the images part of the app
added go generate info to help generate mocks for tests
 2019-03-22 00:14:34 +01:00
Philipp Häfelfinger 3c3eaa8da7 generated mocks for the datastore 2019-03-21 22:37:16 +01:00
Philipp Häfelfinger ce64892222 added mocks for piwigo context 2019-03-21 22:37:08 +01:00
Philipp Häfelfinger 061bb112d5 formatting 2019-03-21 22:31:16 +01:00
Philipp Häfelfinger f71fcefc1a removed flag piwigoUploadChunkSizeInKB as it gets loaded from the server during login. Default is 512KB 2019-03-20 23:51:01 +01:00
Philipp Häfelfinger 4d50d5bb15 changed usage to piwigo interface instead of context 2019-03-20 23:30:04 +01:00
Philipp Häfelfinger b326b0da84 added uploadImages 
added piwigo image id to upload to support file updates
added noUpload flag to do all but skip file upload
changed metadata filepath to full file path
moved category detection during local file metadata generation
 2019-03-20 23:15:41 +01:00
Philipp Häfelfinger 8e3c736bf9 added interfaces to the piwigo context to make testing easier 2019-03-20 21:41:41 +01:00
Philipp Häfelfinger 390a60418f added unittest to test upload required in datastore -> probably not a good idea to set the flag here ;-) 2019-03-20 00:33:53 +01:00
Philipp Häfelfinger 28f7b6eaef fixed messages and stop processing if no images are ready to process 2019-03-20 00:31:23 +01:00
Philipp Häfelfinger f40308e378 fixed upload required 2019-03-20 00:31:09 +01:00
Philipp Häfelfinger a871cfbb11 fixed missing reset of the uploadRequired flag 2019-03-20 00:24:09 +01:00
Philipp Häfelfinger 8068d829fe Refactored piwigo context to a object oriented implementation 
Optimized http calls to reuse more code and DRY
Interface for PiwigoContext WIP
Naming WIP
 2019-03-20 00:17:58 +01:00
Philipp Häfelfinger f3f864ec49 Removed old empty method 
added synchronizePiwigoMetadata implementations to update local metadata from piwigo
 2019-03-19 23:08:28 +01:00
Philipp Häfelfinger 7bf14e5ca3 Added SavePiwigoIdAndUpdateUploadFlag 2019-03-19 23:07:55 +01:00
Philipp Häfelfinger 58b5b79b34 renamed ImageUploadRequired to ImageExistOnPiwigo 
Added ImageCheckFile to check the piwigo file state
 2019-03-19 23:07:39 +01:00
Philipp Häfelfinger 00404788cb Renamed methods as GO has no Getter or Setter 2019-03-19 21:21:45 +01:00
Philipp Häfelfinger 5166b0c6b8 started synchronization of piwigo ids and upload required 2019-03-17 23:57:28 +01:00
Philipp Häfelfinger 20eeba2615 made cookiejar internal 2019-03-17 23:48:44 +01:00
Philipp Häfelfinger 066f8f5f95 extended datastore to get the images that should be uploaded 2019-03-17 23:36:40 +01:00
Philipp Häfelfinger 798b74d071 Implemented synchronizeLocalImageMetadata to build the local image database 2019-03-17 23:11:56 +01:00
Philipp Häfelfinger 2333eccd0e added column UploadRequired to the image metadata 2019-03-17 22:59:18 +01:00
Philipp Häfelfinger 02f59c47f9 made checksum calculator exportable to use it in the app package 2019-03-17 22:58:49 +01:00
Philipp Häfelfinger 10ffa029f8 started rethinking of the image upload process 2019-03-16 00:11:57 +01:00
Philipp Häfelfinger faa7a33f8f save dataStore context field as reference type 2019-03-15 23:54:22 +01:00
Philipp Häfelfinger b917511e95 Added first datastore implementation with tests 2019-03-15 23:53:47 +01:00
Philipp Häfelfinger 9ca31bcb2b started adding sqlite code 2019-03-15 00:35:49 +01:00
Philipp Häfelfinger 5bf0b0b4e1 added first unit test 2019-03-13 00:14:19 +01:00
Philipp Häfelfinger cd226af651 Fixed go test findings on method usage 2019-03-12 23:52:04 +01:00
Philipp Häfelfinger 2cc33641a7 moved filesystemnode to the filesystem scanner 2019-03-12 23:47:19 +01:00
Philipp Häfelfinger 105c89538e moved imagenode to the imagelist file where it gets created 2019-03-12 23:46:35 +01:00
Philipp Häfelfinger 5a4c133f27 moved app types to appContext.go and added some methods 
moved piwigo login from app.go to piwigoContext.go
Updated visibility of some types
Added first elements of the local data store including configuration on startup and flag
yea yea... I know, the commit contains to many changes ;-)
 2019-03-12 23:44:05 +01:00
Philipp Häfelfinger eae6db1683 refactored piwigo context to a interface on most of the functions 2019-03-11 22:16:55 +01:00
Philipp Häfelfinger 6064e94858 moved piwigo authentication 2019-03-11 21:47:16 +01:00
Philipp Häfelfinger a194e2f5ae merged piwigo category code 2019-03-11 21:45:46 +01:00
Philipp Häfelfinger b089bf34ee merged all picture code in one go file as it is small and go works with different rules for handling code files than c# 2019-03-11 21:42:20 +01:00
Philipp Häfelfinger 3e7cc0fd2d renamed project to PiwigoDirectoryUploader 2019-03-03 23:44:13 +01:00
Philipp Häfelfinger 951c8249dd removed duplicated log message 2019-03-03 23:21:46 +01:00
Philipp Häfelfinger e1c1f9578a made local image preparations use channels and go routines to speed it up and use all cpu cores to calculate the md5 sums 2019-03-03 22:35:24 +01:00
Philipp Häfelfinger cc778e5615 added sort to populate by category not by random file order 2019-03-02 00:32:15 +01:00
Philipp Häfelfinger 8659aba430 fixed log output of total file size 2019-03-02 00:25:24 +01:00
Philipp Häfelfinger bfd90cf1b6 made upload of images work 2019-03-02 00:21:01 +01:00
Philipp Häfelfinger 515a3c6950 added category output 2019-03-01 21:51:37 +01:00
Philipp Häfelfinger 665f0e18e1 fixed missing directory handling 2019-03-01 21:51:30 +01:00
Philipp Häfelfinger 930d27bff7 fixed namespace and clone target 2019-03-01 21:36:16 +01:00
Philipp Häfelfinger 704a3da759 small http handling optimization 2019-03-01 00:26:15 +01:00
Philipp Häfelfinger 28f89c54d5 started upload file implementation 2019-03-01 00:14:52 +01:00
Philipp Häfelfinger 958631df5d filtering all except png and jpg 2019-02-28 22:30:58 +01:00
Philipp Häfelfinger a4a6cce943 made finding missing files work 2019-02-27 23:26:18 +01:00
Philipp Häfelfinger 45db2fe79b made app context internal to the app parts 2019-02-27 22:13:23 +01:00
Philipp Häfelfinger 2808c85147 added md5 sums to the local file upload indexing 2019-02-27 22:11:47 +01:00
Philipp Häfelfinger 643729af1f started coding of image handling 2019-02-27 00:09:41 +01:00
Philipp Häfelfinger 5ea9fa2911 optimized handling if no category is missing 2019-02-26 22:55:45 +01:00
Philipp Häfelfinger 9e20d4ecc2 removed blocking error message 2019-02-26 22:51:42 +01:00
Philipp Häfelfinger 669bb18cf4 made category create work 2019-02-26 22:50:33 +01:00
Philipp Häfelfinger d80348053e prepared some parameters 2019-02-26 00:02:22 +01:00
Philipp Häfelfinger 50e6979b00 inverted if for better readability 2019-02-26 00:00:21 +01:00
Philipp Häfelfinger 2195920b38 updated path handling 2019-02-25 23:58:44 +01:00
Philipp Häfelfinger 470df78264 error handling one more time :-D 2019-02-25 23:51:18 +01:00
Philipp Häfelfinger 1fbf889a4b fixed category path separator usage 2019-02-25 23:40:26 +01:00
Philipp Häfelfinger 6df316fe19 restructured the app code a bit 
updated errorhandling to make exit codes only in app.go
 2019-02-25 23:36:18 +01:00
Philipp Häfelfinger fbd92489f2 added category tree build up and missing category detection 2019-02-25 23:11:09 +01:00
Philipp Häfelfinger e6e7e46fd1 added first query to get categories 
moved piwigo context to the upper package piwigo
 2019-02-25 00:02:59 +01:00
Philipp Häfelfinger f65698c587 automatically add the rpc php part to the url 2019-02-24 23:39:55 +01:00
Philipp Häfelfinger b6ba48b2ab updated errorhandling again 2019-02-24 23:32:05 +01:00
Philipp Häfelfinger a897d82bfa refactored errorhandling one more time :-D 2019-02-24 23:27:31 +01:00
Philipp Häfelfinger 6472eeba37 added iniflags to support config files 2019-02-24 23:11:52 +01:00
Philipp Häfelfinger a8890c1d2d refactored error handling 2019-02-24 21:38:28 +01:00
Philipp Häfelfinger ca43177d49 code cleanup 2019-02-24 21:28:07 +01:00
Philipp Häfelfinger ff00ca9f0a format and function visibility fixed 2019-02-24 01:17:10 +01:00
Philipp Häfelfinger 4721c762f1 implemented piwigo authentication code with cookiehandling 2019-02-24 00:33:46 +01:00
Philipp Häfelfinger 37f6aefe5e formatted / restructured app folder 2019-02-23 22:02:12 +01:00
Philipp Häfelfinger 894a039591 restructured project folders 2019-02-23 21:57:54 +01:00