Volume 1 Issue 2 | 2024 | View PDF
Paper Id: IJMSM-V1I2P104
doi: 10.64137/30485037/V1I2P104

The Integration of Big Data and Business Intelligence: Challenges and Future Directions

Rahul Cherekar

Citation:
Rahul Cherekar, "The Integration of Big Data and Business Intelligence: Challenges and Future Directions" International Journal of Multidisciplinary on Science and Management, Vol. 1, No. 2, pp. 38-48, 2024.

Abstract:
BI and big data provide insights for the business which are helping to re-form the procedures of business. Several industries are now using Big Data analysis to improve performance, customer satisfaction, and operations. This paper seeks to discuss the integration of big data and BI focusing on the opportunities that come with it and the problems that may be encountered while at it. It explains the main topics, including information obtainment, data storage and analysis, and data visualization. The other subtopic discusses technological support like cloud computing, AI, and ML in developing BI-enhanced features. Nonetheless, several issues arise when applying Big Data with BI systems, such as data quality, governance, scalability, and real-time processing. The paper also explores possible areas of development like edge computing, blockchain and the enormous potential that quantum computing holds in Big Data analysis. Thus, this research aims to offer a rich understanding of how organizations can use Big Data with BI to gain competitive superiority. In this paper, based on the literature review, methodological framework, and survey findings, we suggest the recommendation for BI to maximize Big Data’s value for enterprises.

Keywords: Big Data, Business Intelligence, Data Analytics, Cloud Computing, Machine Learning, Artificial Intelligence, Data Governance.

References:
1. Chen, H., Chiang, R. H., & Storey, V. C. (2012). Business intelligence and analytics: From big data to big impact. MIS Quarterly, 1165-1188.
2. Kimball, R., & Ross, M. (2013). The data warehouse toolkit: The definitive guide to dimensional modeling. John Wiley & Sons.
3. Inmon, W. H. (2005). Building the data warehouse. John Wiley & sons.
4. Sun, Z., Zou, H., & Strang, K. (2015). Big data analytics as a service for business intelligence. In Open and Big Data Management and Innovation: 14th IFIP WG 6.11 Conference on e-Business, e-Services, and e-Society, I3E 2015, Delft, The Netherlands, October 13-15, 2015, Proceedings 14 (pp. 200-211). Springer International Publishing.
5. Jagadish, H. V., Gehrke, J., Labrinidis, A., Papakonstantinou, Y., Patel, J. M., Ramakrishnan, R., & Shahabi, C. (2014). Big data and its technical challenges. Communications of the ACM, 57(7), 86-94.
6. Russom, P. (2011). Big data analytics. TDWI best practices report, fourth quarter, 19(4), 1-34.
7. Brynjolfsson, E., Hitt, L. M., & Kim, H. H. (2011). Strength in numbers: How does data-driven decision-making affect firm performance? Available at SSRN 1819486.
8. Manyika, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C., & Hung Byers, A. (2011). Big data: The next frontier for innovation, competition, and productivity.
9. Luhn, H. P. (1958). A business intelligence system. IBM Journal of research and development, 2(4), 314-319.
10. Chen, C. P., & Zhang, C. Y. (2014). Data-intensive applications, challenges, techniques, and technologies: A survey on Big Data. Information sciences, 275, 314-347.
11. Raghupathi, W., & Raghupathi, V. (2014). Big data analytics in healthcare: promise and potential. Health information science and systems, 2, 1-10.
12. Gandomi, A., & Haider, M. (2015). Beyond the hype: Big data concepts, methods, and analytics. International journal of information management, 35(2), 137-144.
13. Agrawal, D., Das, S., & El Abbadi, A. (2011, March). Big data and cloud computing: current state and future opportunities. In Proceedings of the 14th International Conference on Extending Database Technology (pp. 530-533).
14. Larson, D., & Chang, V. (2016). A review and future direction of agile, business intelligence, analytics and data science. International Journal of Information Management, 36(5), 700-710.
15. Chen, H., Chiang, R. H. L., & Storey, V. C. (2012). Business Intelligence and Analytics: From Big Data to Big Impact. MIS Quarterly, 36(4), 1165–1188. https://doi.org/10.2307/41703503
16. Jovanovič, U., Štimec, A., Vladušič, D., Papa, G., & Šilc, J. (2015). Big-data analytics: a critical review and some future directions. International Journal of Business Intelligence and Data Mining, 10(4), 337-355.
17. Sun, Z., Sun, L., & Strang, K. (2018). Big data analytics services for enhancing business intelligence. Journal of Computer Information Systems, 58(2), 162-169.
18. Liang, T. P., & Liu, Y. H. (2018). Research landscape of business intelligence and big data analytics: A bibliometrics study. Expert Systems with Applications, 111, 2-10.
19. Chen, Y., Li, C., & Wang, H. (2022). Big data and predictive analytics for business intelligence: A bibliographic study (2000–2021). Forecasting, 4(4), 767-786.
20. Wixom, B. H., Yen, B., & Relich, M. (2013). Maximizing Value from Business Analytics. MIS Quarterly Executive, 12(2), 111–123.
21. Cherekar, R. (2020). DataOps and Agile Data Engineering: Accelerating Data-Driven Decision-Making. International Journal of Emerging Research in Engineering and Technology, 1(1), 31-39. https://doi.org/10.63282/3050-922X.IJERET-V1I1P104
22. Cherekar, R. (2020). The Future of Data Governance: Ethical and Legal Considerations in AI-Driven Analytics. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 3(2), 53-60. https://doi.org/10.63282/3050-9262.IJAIDSML-V3I2P107
23. R. Daruvuri, “An improved AI framework for automating data analysis,” World Journal of Advanced Research and Reviews, vol. 13, no. 1, pp. 863–866, Jan. 2022, doi: 10.30574/wjarr.2022.13.1.0749.
24. Cherekar, R. (2022). Cloud Data Governance: Policies, Compliance, and Ethical Considerations. International Journal of AI, BigData, Computational and Management Studies, 3(2), 24-31. https://doi.org/10.63282/3050-9416.IJAIBDCMS-V3I2P103
25. Cherekar, R. (2021). The Future of AI Quality Assurance: Emerging Trends, Challenges, and the Need for Automated Testing Frameworks. International Journal of Emerging Trends in Computer Science and Information Technology, 2(1), 19-27. https://doi.org/10.63282/3050-9246.IJETCSIT-V1I2P104
26. Cherekar, R. (2020). Cloud-Based Big Data Analytics: Frameworks, Challenges, and Future Trends. International Journal of AI, Big Data, Computational and Management Studies, 1(1), 31-39. https://doi.org/10.63282/3050-9416.IJAIBDCMS-V4I1P107
27. Cherekar, R. (2023). A Comprehensive Framework for Quality Assurance in Artificial Intelligence: Methodologies, Standards, and Best Practices. International Journal of Emerging Research in Engineering and Technology, 4(2), 43-51. https://doi.org/10.63282/3050-922X.IJERET-V4I2P105
28. Cherekar, R. (2023). Automated Data Cleaning: AI Methods for Enhancing Data Quality and Consistency. International Journal of Emerging Trends in Computer Science and Information Technology, 5(1), 31-40. https://doi.org/10.63282/3050-9246.IJETCSIT -V5I1P105