Data Mining Issues - Report Example

Data Mining Issues For addressing individual privacy, data mining technology is not up to the mark. Likewise, it also links data mining to be considered as a social facet. To inspect and study the customer’s buying habits and preferences from the market or predicting valuable patterns that will facilitate in creating futuristic decisions, business transactions are calculated along with the procurement of associated information. Data integrity plays a crucial role in data mining for providing authentic data that can be trusted. Likewise, the challenge is to consolidate unpredictable data collected from several sources. For instance, a financial institution or a bank utilized various techniques, tools, databases and methods for capturing data, in order to manage credit card accounts of their customers. Although, there are certain variations while gathering or capturing data in different formats, it is because of dissimilar software products. For addressing these issues, software products must be able to cope up with different systems running on different platforms, in order to gather data in a standardized format. A database where data is maintained in tabular form is called as a relational database. Relational database can be utilized for data mining techniques for addressing specific queries. As the technology associated with client/server architecture is progressing at a rapid pace and storage is managed at a single location that can be a preferred location for data mining. As there are many hardware equipment manufacturers in the market, cost of hardware has relatively minimized because of tough competition, as a result, the structure of data mining queries has also changed for utilizing optimal hardware features. Likewise, data mining queries are more powerful than before and extract optimal value form the data at ultimate speeds. Speed augments the amount of data acquisition during data mining process and at the same time provides valuable information to make informed decisions. In the process of data mining, the data associated with people has risky ethical significances. Data mining experts need to deploy norms for making the data application resilient. As far as humans are concerned, this method is associated with disparity along with behaviors such as racialism, as they are negative to norms. Perception that is considered as another example is dependent on the applied classification, as it is recognized in splitting a disease that needs urgent attention. However, in case of a financial institution or a bank, loan acquisition is a non-ethical characteristic. Similarly, there are numerous factors that may be relevant to data mining. For instance, a report that was published from a leading consumer illustrated that in France, customer possessing a red car are more likely to be defaulters in returning loans back. As it is a debatable issue on categorizing it as ethical or non-ethical issue, similarly, insurance companies are always selected and discriminating because the differentiation factor includes a young person with an old lady is addressed in associated statistics, as young people have more likely hood of accidents, resulting in high insurance returns for their damaged cars. Other various issues pertain to data mining is techniques, tools, user involvement, performance and various types of data. A comprehensive discussion for each of them is as follows: Methods of Mining and Interaction Concerns This issue pertains to the information extracted from databases and reviews the capability to gain information, as it focuses on mining information at many levels, the usability of issues associated with domains along with knowledge conception. Mining several kinds of Information There are several different criteria that should be addressed by data associated with variety of data analysis and information discovery jobs. Moreover, jobs associated with data mining comprises of characterization, association / co relation and cluster analysis along with classification and forecast. Likewise, these jobs will utilize a single database for data mining and gives results as an output in several methods. Collaborative Mining for Extracting Information It is difficult to predict the form along with composition of a database, as the purpose is to be iterative. Likewise, it can be allocated in different parts by applying sampling techniques along with providing techniques to the data mining specialist for making things easy and to save memory space as well. Synchronizing Contextual Information Retaining the contextual information on the issue within a domain is a direction to define or decide the obscured data criteria that is demonstrated into summarizing terms. However, for a robust data mining process, domain knowledge is essential, as it analyze useful patterns that are associated with a set criterion. Query Language for Data Mining Relational query language is valuable option as Structured Query Language (SQL) provides data mining specialist an option to implement various queries for acquiring specific set of data. However, for high level data processing in data mining, query languages are complex and far more advanced. These queries facilitate data mining experts to implement data mining jobs associated with domain knowledge. Moreover, these queries are also easily integrated with state of the art applications that are operational in data warehouses. Furthermore, along with integration, these queries also aid data mining experts to execute queries for quality data acquisition. Information Visualization The high level information extracted from databases is illustrated as high level visual representations and will activate data mining specialist to realize and apprehend the data. However, interacting on a high level requires an aid of graphical representations such as graphs, bar charts, tables and rules. Organizing Ineffectual Data Database also contains a large amount of extraneous data or incomplete data that creates hurdles in the process of data miming, as the algorithms and criteria are set to gather information from complete data, incomplete data also plays its part and make the process complex and in accurate in some cases. However, the best option is to clean the data initially by data cleaning and analysis techniques and methods before utilizing it in the data mining process. Valuating Patterns Valuating patterns is an absolute essential task to perform. As there are numerous patterns that are extracted within the data mining processes and techniques, data mining specialist only analyze relevant and adequate patterns of data. This process involves high level expertise along with expert application knowledge, domain background knowledge issues and limitations associated with specific users. All these factors can limit the searching process for valid pattern discovery of data. Performance Limitations Data mining performance bottlenecks are linked with scalability, capability, and analogy of the data mining methods and procedures. Likewise, for making the data mining process effective, acquisition of information from data warehouses acquiring numerous databases is necessary. However, there are certain challenges when accessing data from large data warehouses, as some of the challenges includes long time delays in process data miming algorithms. However, the solution for this challenge is to incorporate distributed and parallel data mining techniques. These techniques can divide data in to different segments for making the process faster. Explanation of the Problematic Domain As per (Camacho, Gharib et al. 2007), Diabetes mellitus is defined as “DM is a chronic disorder of glucose homeostasis characterized by hyperglycemia and impaired insulin action, with abnormal pancreatic insulin secretion as well as increased rates of hepatic glucose production. Unlike type 1 DM, no absolute physiological lack of insulin is present”. Diabetes is a disease that may be considered as a primary driving factor for some of the other health issues. For instance, diabetes imposes almost 100% risk for vascular diseases such as cardiovascular diseases along with creating issues in kidneys and the brain as well. A recent survey was published that illustrates the number of diabetic patients exceeding from more than 285 million globally. Likewise, diabetic patients are more common in well developed countries, however, study shows that it may gain a significant number of patients in Africa and Asia. Likewise, in the middle east and north Africa, currently there are minimum 27 million patients suffering from diabetes mellitus. Moreover, in the United Arad Emirates, almost one third of the population is suffering from this disease. A study demonstrated the overall cost of this disease throughout the world is $376 Billion annually. It is now almost fundamental that a person exceeding an age of 60 have more chances to get this disease, as it is now considered as the fourth largest live taking disease globally along with making its name for the fourth most common disease that contributes to a death of a person. However, the most common of all diabetes is the type 2. As there are almost 20% habitants suffering from in the United Arab Emirates alone, many research studies and debates are conducted yearly in Dubai and Abu Dhabi. Moreover, awareness sessions are conducted in every town of the cities to aware the people about this disease (Zain 2009). However, this case study demonstrates the disease diabetes and medical data associated with patients from the Middle east region i.e. United Arab Emirates for discovering concealed patterns and the valuable information that can be utilized for decision making process. In addition, these informed decisions are performed by medical personnel and practitioners. Therefore, this case study can be utilized for illustrating the requirements for medication for each type of diabetes and also forecast the futuristic elements reflected in the extracted data. References KEATING, B., 2008. Data Mining: what is it and how is it Used? Journal of Business Forecasting, 27(3), pp. 33-35. CAMACHO, P.M., GHARIB, H. and SIZEMORE, G.W., 2007. Evidence-based endocrinology Philadelphia: Lippincott Williams & Wilkins. ZAIN , A.A., 13/09/2009, 2009-last update, UAE launches diabetes awareness campaign . Available: http://www.khaleejtimes.com/DisplayArticle09.asp?xfile=data/theuae/2009/November/theuae_November422.xml§ion=theuae [3/20/2012, 2012]. Read More