* add text classification transformers
* add ner
* use specified model for tasks; allow summary in BERT
* update notebooks and dockerfile
* links for notebooks on colab
* links for notebooks on colab
* update notebooks image path for colab
* deleted lavis from utils
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fixed test_objects
* added 'not gcv' to CI
* fixed multimodal search and summary tests
* disable doc build on PR for now
* restrict ipywidgets version to avoid dummycomm error
* limit deepface version
* original repositories for retinaface lavis
* update gcv test results
* update display test outputs
* update test env
* run all tests
* wo xdist to avoid segfault
* remove widgets ref
* skip long-running tests
* skip long
* verbose codecov upload
* refactor summary test 2
* finish summary test refactor
* reduce memory overhead of SummaryDetector
* remove VQA models from self
* remove VQA models from self
* update notebook for changes
* update notebook for changes
* fixed multimodal search tests
* fixed tests in multimodal search after precommit
* run all tests
* update doc notebook for summary changes
* skip long-running multimodal
* exclude blip2 from testing
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Inga Ulusoy <inga.ulusoy@uni-heidelberg.de>
* add image summary notebook
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* pin deepface version to avoid bug with progress bar after update
* update actions version for checkout and python
* test ci without lavis
* no lavis for ci test
* merging
* return lavis
* change lavis to salesforce-lavis
* change pycocotools install method
* change pycocotools install method
* fix_pycocotools
* Downgrade Python
* back to 3.9 and remove pycocotools dependance
* instrucctions for windows
* missing comma after merge
* lavis only for ubuntu
* use lavis package name in install instead of git
* adding multimodal searching py and notebook
* exclude lavis on windows
* skip import on windows
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* reactivate lavis
* Revert "reactivate lavis"
This reverts commit ecdaf9d316e4b08816ba62da5e0482c8ff15b14e.
* Change input format for multimodal search
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix clip models
* account for new interface in init imports
* changed imports bec of lavis/windows
* fix if-else, added clip ViT-L-14=336 model
* fix code smells
* add model change function to summary
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fixed new model in summary.py
* fixed summary windget
* moved some function to utils
* fixed imort torch in utils
* added test_summary.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fixed opencv version
* added first test of multimodal_search.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fixed test
* removed windows in CI and added test in multimodal search
* change lavis from dependencies from pip ro git
* fixed blip2 model in test_multimodal_search.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fixed test multimodal search on cpu and gpu machines
* added test, fixed dependencies
* add -vv to pytest command in CI
* added test_multimodal_search tests
* fixed tests in test_multimodal_search.py
* fixed tests in test_summary
* changed CI and fixed test_multimodel search
* fixed ci
* fixed error in test multimodal search, changed ci
* added multimodal search test, added windows CI, added picture in test data
* CI debuging
* fixing tests in CI
* fixing test in CI 2
* fixing CI 3
* fixing CI
* added filtering function
* Brought back all tests after CI fixing
* changed CI one pytest by individual tests
* fixed opencv problem
* fix path for text, adjust result for new gcv
* remove opencv
* fixing cv2 error
* added opencv-contrib, change objects_cvlib
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fixing tests in CI
* fixing CI testing
* cleanup objects
* fixing codecov in CI
* fixing codecov in CI
* run tests together; install opencv last
* update requirements for opencv dependencies
* moved lavis functions from utils to summary
* Remove lavis from utils.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add missing jupyter
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: iulusoy <inga.ulusoy@uni-heidelberg.de>
* add bertopic to requirements
* basic topic modeling
* topic modeling using BERT; bugfix if no text on post
* update for google colab
* Catch connection errors
* replace newline character with space
* move topic analysis into PostprocessText class
* set up dataflow topic analysis
* expose topic model to UI
* tests for class init
* tests for topic analysis
* more tests
* take care of carriage return on windows
* take care of carriage return on windows
* take care of carriage return on windows
* set encoding to ensure windows compatibility
* track encoding error
* more debug
* skip topic analysis debug
* windows fixes
* lower python version for google colab
* faces working with colab
* text for colab
* fix dict update bug
* final edits for colab
* update readme with links
* load text models on demand
* update test
* fix typo; more description in readme
* remove optional keys
* update notebook
* comments
* add jupyterlab
* add text analysis capability
* add bool in tests
* add dependencies and spelling test
* add test sentiment
* update black pre-commit dependency for native nb support
* update black version, find better sentiment test
* test analyse_image
* start with translate
* translate and clean - notebook
* spacy model in requirements
* translate in module
* clean in module
* upload coverage only for ubuntu
* update ubuntu version on runner
* update dependencies
* start tests for text
* skip gcv test
* fix age
* more text tests
* more text tests
* add comment
* test translation
* fix numpy version; add reference data for trans
* use utf-8 for windows
* colors expression by KMean algorithm
* object detection by imageai
* object detection by cvlib
* add encapsulation of object detection
* remove encapsulation of objdetect v0
* objects expression to dict
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* added imageai to requirements
* add objects to dictionary
* update for AnalysisMethod baseline
* add objects dection support explore_analysis display
* extend python version of misinf to allow imageai
* account for older python
* use global functionality for dict to csv convert
* update for docker build
* docker will build now but ipywidgets still not working
* test code
* include test data folder in repo
* add some sample images
* load cvs labels to dict
* add test data
* retrigger checks
* add map to human coding
* get orders from dict, missing dep
* add module to test accuracy
* retrigger checks
* retrigger checks
* now removing imageai
* removed imageai
* move labelmanager to analyse
* multiple faces in mydict
* fix pre-commit issues
* map mydict
* hide imageai
* objects default using cvlib, isolate and disable imageai
* correct python version
* refactor faces tests
* refactor objects tests
* sonarcloud issues
* refactor utils tests
* address code smells
* update readme
* update notebook without imageai
Co-authored-by: Ma Xianghe <825074348@qq.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: iulusoy <inga.ulusoy@uni-heidelberg.de>
* convert into dict output
* faces class
* return cleaned dict
* empty methods that are required
* with dict updates
* with dominant emotion confidence as tuple
* multiple images
* update notebook
* read image into nb
* test
* added keras-ocr and google vision
* google cloud vision by far the best
* setting up docker for text 1
* move widgets and analysis to display module
* move widgets and analysis to display module - 2
* text on image through widgets
