diff --git a/README.md b/README.md
index f56d52d09bcfa58e3059282f66f81ec8df1d5c51..4c3b1f45b0c06444037ab44c45da5ac819a4a683 100755
--- a/README.md
+++ b/README.md
@@ -1,18 +1,19 @@
**About PyTorch 1.2.0**
* Now the master branch supports PyTorch 1.2.0 by default.
- * Due to the serious version problem (especially torch.utils.data.dataloader), MDSR functions are temporarily disabled. If you have to train/evaluate the MDSR model, please use legacy branches.
-# EDSR-PyTorch
+# EDSR-sspcab
**About PyTorch 1.1.0**
* There have been minor changes with the 1.1.0 update. Now we support PyTorch 1.1.0 by default, and please use the legacy branch if you prefer older version.
-
+<img width="712" alt="스크린샷 2023-04-09 오후 1 01 52" src="https://user-images.githubusercontent.com/90498398/236676450-5e7d3073-e2b0-47da-bc13-8187581af0e2.png">
+<img width="298" alt="스크린샷 2023-05-03 오후 8 07 38" src="https://user-images.githubusercontent.com/90498398/236676461-02a1bc78-14c7-4144-852f-4886d3ffae60.png">
-This repository is an official PyTorch implementation of the paper **"Enhanced Deep Residual Networks for Single Image Super-Resolution"** from **CVPRW 2017, 2nd NTIRE**.
-You can find the original code and more information from [here](https://github.com/LimBee/NTIRE2017).
+This study aims to restore resolution to improve image quality. The entire framework consists of two models, vdsr and mask-attention. If SR-reconstruction works well using two models, the loss value is low, and if SR-reconstruction does not work well, the loss value is high, so it is a model that focuses on hard samples. This allows us to focus on samples that are difficult to rebuild, and is a kind of ensemble (mining technique that focuses on hard samples) as an opportunity to make more use of local details.
+In addition, this study placed restrictions on convolution using masks when learning models. Through this, when testing the model, it can be effectively applied to reconstruct the image.
-If you find our work useful in your research or publication, please cite our work:
+Model 을 2 개 사용하여 SR-reconstruction 이 잘 되면 loss 값이 낮고 SR-reconstruction 이 잘 안되면 loss 값이 높으므로 하드 샘플에 집중하는 모델이다. 이를 통하여 재구축이 힘든 샘플에 집중할 수 있게 되고,localdetail을 좀 더 살릴 수 있는 계기로(하드 샘플에 집중하는 마이닝 기법) 앙상블의 일종이다.
+또한 이 연구는 모델 학습을 할 때, 컨볼루션에 마스크를 사용하여 재한을 두었다. 이를 통하여 모델을 테스트 할 때, 이미지 재구성이 하는데 효과적으로 적용할 수 있다.
[1] Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee, **"Enhanced Deep Residual Networks for Single Image Super-Resolution,"** <i>2nd NTIRE: New Trends in Image Restoration and Enhancement workshop and challenge on image super-resolution in conjunction with **CVPR 2017**. </i> [[PDF](http://openaccess.thecvf.com/content_cvpr_2017_workshops/w12/papers/Lim_Enhanced_Deep_Residual_CVPR_2017_paper.pdf)] [[arXiv](https://arxiv.org/abs/1707.02921)] [[Slide](https://cv.snu.ac.kr/research/EDSR/Presentation_v3(release).pptx)]
```
@@ -23,15 +24,13 @@ If you find our work useful in your research or publication, please cite our wor
month = {July},
year = {2017}
}
+@inproceedings{Ristea-CVPR-2022,
+ title={Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection},
+ author={Ristea, Nicolae-Catalin and Madan, Neelu and Ionescu, Radu Tudor and Nasrollahi, Kamal and Khan, Fahad Shahbaz and Moeslund, Thomas B and Shah, Mubarak},
+ booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
+ year={2022}
+}
```
-We provide scripts for reproducing all the results from our paper. You can train your model from scratch, or use a pre-trained model to enlarge your images.
-
-**Differences between Torch version**
-* Codes are much more compact. (Removed all unnecessary parts.)
-* Models are smaller. (About half.)
-* Slightly better performances.
-* Training and evaluation requires less memory.
-* Python-based.
## Dependencies
* Python 3.6
@@ -49,36 +48,6 @@ Clone this repository into any place you want.
git clone https://github.com/thstkdgus35/EDSR-PyTorch
cd EDSR-PyTorch
```
-
-## Quickstart (Demo)
-You can test our super-resolution algorithm with your images. Place your images in ``test`` folder. (like ``test/<your_image>``) We support **png** and **jpeg** files.
-
-Run the script in ``src`` folder. Before you run the demo, please uncomment the appropriate line in ```demo.sh``` that you want to execute.
-```bash
-cd src # You are now in */EDSR-PyTorch/src
-sh demo.sh
-```
-
-You can find the result images from ```experiment/test/results``` folder.
-
-| Model | Scale | File name (.pt) | Parameters | ****PSNR** |
-| --- | --- | --- | --- | --- |
-| **EDSR** | 2 | EDSR_baseline_x2 | 1.37 M | 34.61 dB |
-| | | *EDSR_x2 | 40.7 M | 35.03 dB |
-| | 3 | EDSR_baseline_x3 | 1.55 M | 30.92 dB |
-| | | *EDSR_x3 | 43.7 M | 31.26 dB |
-| | 4 | EDSR_baseline_x4 | 1.52 M | 28.95 dB |
-| | | *EDSR_x4 | 43.1 M | 29.25 dB |
-| **MDSR** | 2 | MDSR_baseline | 3.23 M | 34.63 dB |
-| | | *MDSR | 7.95 M| 34.92 dB |
-| | 3 | MDSR_baseline | | 30.94 dB |
-| | | *MDSR | | 31.22 dB |
-| | 4 | MDSR_baseline | | 28.97 dB |
-| | | *MDSR | | 29.24 dB |
-
-*Baseline models are in ``experiment/model``. Please download our final models from [here](https://cv.snu.ac.kr/research/EDSR/model_pytorch.tar) (542MB)
-**We measured PSNR using DIV2K 0801 ~ 0900, RGB channels, without self-ensemble. (scale + 2) pixels from the image boundary are ignored.
-
You can evaluate your models with widely-used benchmark datasets:
[Set5 - Bevilacqua et al. BMVC 2012](http://people.rennes.inria.fr/Aline.Roumy/results/SR_BMVC12.html),
@@ -88,99 +57,3 @@ You can evaluate your models with widely-used benchmark datasets:
[B100 - Martin et al. ICCV 2001](https://www2.eecs.berkeley.edu/Research/Projects/CS/vision/bsds/),
[Urban100 - Huang et al. CVPR 2015](https://sites.google.com/site/jbhuang0604/publications/struct_sr).
-
-For these datasets, we first convert the result images to YCbCr color space and evaluate PSNR on the Y channel only. You can download [benchmark datasets](https://cv.snu.ac.kr/research/EDSR/benchmark.tar) (250MB). Set ``--dir_data <where_benchmark_folder_located>`` to evaluate the EDSR and MDSR with the benchmarks.
-
-You can download some results from [here](https://cv.snu.ac.kr/research/EDSR/result_image/edsr-results.tar).
-The link contains **EDSR+_baseline_x4** and **EDSR+_x4**.
-Otherwise, you can easily generate result images with ``demo.sh`` scripts.
-
-## How to train EDSR and MDSR
-We used [DIV2K](http://www.vision.ee.ethz.ch/%7Etimofter/publications/Agustsson-CVPRW-2017.pdf) dataset to train our model. Please download it from [here](https://cv.snu.ac.kr/research/EDSR/DIV2K.tar) (7.1GB).
-
-Unpack the tar file to any place you want. Then, change the ```dir_data``` argument in ```src/option.py``` to the place where DIV2K images are located.
-
-We recommend you to pre-process the images before training. This step will decode all **png** files and save them as binaries. Use ``--ext sep_reset`` argument on your first run. You can skip the decoding part and use saved binaries with ``--ext sep`` argument.
-
-If you have enough RAM (>= 32GB), you can use ``--ext bin`` argument to pack all DIV2K images in one binary file.
-
-You can train EDSR and MDSR by yourself. All scripts are provided in the ``src/demo.sh``. Note that EDSR (x3, x4) requires pre-trained EDSR (x2). You can ignore this constraint by removing ```--pre_train <x2 model>``` argument.
-
-```bash
-cd src # You are now in */EDSR-PyTorch/src
-sh demo.sh
-```
-
-**Update log**
-* Jan 04, 2018
- * Many parts are re-written. You cannot use previous scripts and models directly.
- * Pre-trained MDSR is temporarily disabled.
- * Training details are included.
-
-* Jan 09, 2018
- * Missing files are included (```src/data/MyImage.py```).
- * Some links are fixed.
-
-* Jan 16, 2018
- * Memory efficient forward function is implemented.
- * Add --chop_forward argument to your script to enable it.
- * Basically, this function first split a large image to small patches. Those images are merged after super-resolution. I checked this function with 12GB memory, 4000 x 2000 input image in scale 4. (Therefore, the output will be 16000 x 8000.)
-
-* Feb 21, 2018
- * Fixed the problem when loading pre-trained multi-GPU model.
- * Added pre-trained scale 2 baseline model.
- * This code now only saves the best-performing model by default. For MDSR, 'the best' can be ambiguous. Use --save_models argument to keep all the intermediate models.
- * PyTorch 0.3.1 changed their implementation of DataLoader function. Therefore, I also changed my implementation of MSDataLoader. You can find it on feature/dataloader branch.
-
-* Feb 23, 2018
- * Now PyTorch 0.3.1 is a default. Use legacy/0.3.0 branch if you use the old version.
- * With a new ``src/data/DIV2K.py`` code, one can easily create new data class for super-resolution.
- * New binary data pack. (Please remove the ``DIV2K_decoded`` folder from your dataset if you have.)
- * With ``--ext bin``, this code will automatically generate and saves the binary data pack that corresponds to previous ``DIV2K_decoded``. (This requires huge RAM (~45GB, Swap can be used.), so please be careful.)
- * If you cannot make the binary pack, use the default setting (``--ext img``).
-
- * Fixed a bug that PSNR in the log and PSNR calculated from the saved images does not match.
- * Now saved images have better quality! (PSNR is ~0.1dB higher than the original code.)
- * Added performance comparison between Torch7 model and PyTorch models.
-
-* Mar 5, 2018
- * All baseline models are uploaded.
- * Now supports half-precision at test time. Use ``--precision half`` to enable it. This does not degrade the output images.
-
-* Mar 11, 2018
- * Fixed some typos in the code and script.
- * Now --ext img is default setting. Although we recommend you to use --ext bin when training, please use --ext img when you use --test_only.
- * Skip_batch operation is implemented. Use --skip_threshold argument to skip the batch that you want to ignore. Although this function is not exactly the same with that of Torch7 version, it will work as you expected.
-
-* Mar 20, 2018
- * Use ``--ext sep-reset`` to pre-decode large png files. Those decoded files will be saved to the same directory with DIV2K png files. After the first run, you can use ``--ext sep`` to save time.
- * Now supports various benchmark datasets. For example, try ``--data_test Set5`` to test your model on the Set5 images.
- * Changed the behavior of skip_batch.
-
-* Mar 29, 2018
- * We now provide all models from our paper.
- * We also provide ``MDSR_baseline_jpeg`` model that suppresses JPEG artifacts in the original low-resolution image. Please use it if you have any trouble.
- * ``MyImage`` dataset is changed to ``Demo`` dataset. Also, it works more efficient than before.
- * Some codes and script are re-written.
-
-* Apr 9, 2018
- * VGG and Adversarial loss is implemented based on [SRGAN](http://openaccess.thecvf.com/content_cvpr_2017/papers/Ledig_Photo-Realistic_Single_Image_CVPR_2017_paper.pdf). [WGAN](https://arxiv.org/abs/1701.07875) and [gradient penalty](https://arxiv.org/abs/1704.00028) are also implemented, but they are not tested yet.
- * Many codes are refactored. If there exists a bug, please report it.
- * [D-DBPN](https://arxiv.org/abs/1803.02735) is implemented. The default setting is D-DBPN-L.
-
-* Apr 26, 2018
- * Compatible with PyTorch 0.4.0
- * Please use the legacy/0.3.1 branch if you are using the old version of PyTorch.
- * Minor bug fixes
-
-* July 22, 2018
- * Thanks for recent commits that contains RDN and RCAN. Please see ``code/demo.sh`` to train/test those models.
- * Now the dataloader is much stable than the previous version. Please erase ``DIV2K/bin`` folder that is created before this commit. Also, please avoid using ``--ext bin`` argument. Our code will automatically pre-decode png images before training. If you do not have enough spaces(~10GB) in your disk, we recommend ``--ext img``(But SLOW!).
-
-* Oct 18, 2018
- * with ``--pre_train download``, pretrained models will be automatically downloaded from the server.
- * Supports video input/output (inference only). Try with ``--data_test video --dir_demo [video file directory]``.
-
-* About PyTorch 1.0.0
- * We support PyTorch 1.0.0. If you prefer the previous versions of PyTorch, use legacy branches.
- * ``--ext bin`` is not supported. Also, please erase your bin files with ``--ext sep-reset``. Once you successfully build those bin files, you can remove ``-reset`` from the argument.