Journal of Information Systems Engineering and Management

Journal of Information Systems Engineering and Management, 2024 - Volume 9 Issue 2, Article No: 26126
https://doi.org/10.55267/iadt.07.14670

Published Online: 22 Apr 2024

Views: 234 | Downloads: 184

In the burgeoning realm of big data, document-oriented NoSQL databases stand out for their flexibility and scalability. This paper delves into the optimization of these databases, specifically through the lens of parallel processing techniques. A comparative study was conducted against the traditional non-parallel approaches, where marked performance enhancements were observed. For instance, the execution time for retrieving movies of a specific year decreased by over 80% when parallel processing was applied, plummeting from 1.578765 seconds to a brisk 0.300000 seconds. Memory usage and CPU utilization were meticulously recorded, revealing up to a 70% reduction in peak memory consumption in certain queries, and a moderate fluctuation in CPU usage between 49.25% to 75.2%. This indicates not only improved efficiency but also a prudent utilization of system capacity, without overtaxing resources. However, the study identified scenarios, such as highly complex queries, where the gains from parallel processing were less pronounced, suggesting a marginal improvement in CPU utilization. While the findings advocate for the adoption of parallel processing in handling intensive data retrieval tasks, it is recommended that future research should further scrutinize the scalability thresholds and explore alternative parallelization strategies to fortify the efficacy of document-oriented NoSQL databases.

NoSQL Parallel Processing Complexity Distributing Parallel Execution

• Adrian, M. (2016). DBMS 2015 numbers paint a picture of slow but steady change. Retrieved from https://itmarketstrategy.com/2016/04/11/dbms-2015-numbers-paint-a-picture-of-slow-but-steady-change/
• Ahmad, A., Paul, A., Din, S., Rathore, M. M., Choi, G. S., & Jeon, G. (2018). Multilevel data processing using parallel algorithms for analyzing big data in high-performance computing. International Journal of Parallel Programming, 46, 508-527.
• Almeida, A., Oliveira, F., Lebre, R., & Costa, C. (2020, December). NoSQL distributed database for dicom objects. In 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (pp. 1882-1885). Piscataway, NJ: IEEE.
• Baqer, Z. T. (2014). Parallel computing for sorting algorithms. Baghdad Science Journal, 11(2), 292-302.
• Belcastro, L., Cantini, R., Marozzo, F., Orsino, A., Talia, D., & Trunfio, P. (2022). Programming big data analysis: principles and solutions. Journal of Big Data, 9(1), 4.
• Bragagnolo, S., Rocha, H., Denker, M., & Ducasse, S. (2018, May). Ethereum query language. In Proceedings of the 1st International Workshop on Emerging Trends in Software Engineering for Blockchain (pp. 1-8). https://doi.org/10.1145/3194113.3194114
• Funke, H., & Teubner, J. (2020). Data-parallel query processing on non-uniform data. Proceedings of the VLDB Endowment, 13(6), 884-897.
• Győrödi, C. A., Dumşe-Burescu, D. V., Zmaranda, D. R., Győrödi, R. Ş., Gabor, G. A., & Pecherle, G. D. (2020). Performance analysis of NoSQL and relational databases with CouchDB and MySQL for application’s data storage. Applied Sciences, 10(23), 8524.
• Hasan, F. F., & Jamaluddin, Z. (2019). An optimised method for fetching and transforming survey data based on SQL and R programming language. Baghdad Science Journal, 16(2), 436-444.
• Haseeb, A., & Pattun, G. (2017). A review on NoSQL: Applications and challenges. International Journal of Advanced Research in Computer Science, 8(1), 203-207.
• Khan, W., & Shahzad, W. (2017). Predictive performance comparison analysis of relational & NoSQL graph databases. International Journal of Advanced Computer Science and Applications, 8(5), 523-530.
• Krishan, K., Gupta, G., & Bhathal, G. S. (2023). A review and comparison of key distributed database characteristics across several NoSQL distributed databases. Journal of Data Acquisition and Processing, 38(1), 321.
• Lith, A., & Mattsson, J. (2010). Investigating storage solutions for large data—A comparison of well performing and scalable data storage solutions for real time extraction and batch insertion of data (Master’s thesis, Chalmers University of Technology, Gothenburg, Sweden). Retrieved from https://odr.chalmers.se/server/api/core/bitstreams/1de7e092-50de-407c-8221-d373e6a41e4e/content
• Mahgoub, A., Medoff, A. M., Kumar, R., Mitra, S., Klimovic, A., Chaterji, S., & Bagchi, S. (2020). OPTIMUSCLOUD: Heterogeneous configuration optimization for distributed databases in the cloud. In 2020 USENIX Annual Technical Conference (USENIX ATC 20) (pp. 189-203). Retrieved from https://www.usenix.org/system/files/atc20-mahgoub.pdf
• Mihai, G. (2020). Comparison between relational and NoSQL databases. Economics and Applied Informatics, 3, 38-42.
• Mohmmed, A. H. (2011). Proposed methods to prevent SQL Injection. Ibn AL-Haitham Journal for Pure and Applied Sciences, 24(2). Retrieved from https://www.iasj.net/iasj/download/f3454c843adf7c48
• Mostafa, S. A. (2020). A case study on B-tree database indexing technique. Journal of Soft Computing and Data Mining, 1(1), 27-35.
• Ordonez, C., & Bellatreche, L. (2018). A survey on parallel database systems from a storage perspective: rows versus columns. In Database and Expert Systems Applications: DEXA 2018 International Workshops, BDMICS, BIOKDD, and TIR, Regensburg, Germany, September 3–6, 2018, Proceedings 29 (pp. 5-20). Cham, Switzerland: Springer.
• Sinuraya, J., Rezky, S. F., & Tarigan, M. (2019, November). Data search using hash join query and nested join query. Journal of Physics: Conference Series, 1361(1). https://doi.org/10.1088/1742-6596/1361/1/012079
• Valduriez, P. (2009). Parallel database management. In Encyclopedia of database systems (pp. 2026-2029). Boston, MA: Springer.
• Wang, Y., Cheng, S., Zhang, X., Leng, J., & Liu, J. (2021). Block storage optimization and parallel data processing and analysis of product big data based on the hadoop platform. Mathematical Problems in Engineering, 2021, 1-14.
• Xu, Y., & Kostamaa, P. (2009). Efficient outer join data skew handling in parallel DBMS. Proceedings of the VLDB Endowment, 2(2), 1390-1396.
• Zhang, Y., Cao, T., Li, S., Tian, X., Yuan, L., Jia, H., & Vasilakos, A. V. (2016). Parallel processing systems for big data: A survey. Proceedings of the IEEE, 104(11), 2114-2136.

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.