MSR- Methodologies for Scientific Research

Transcription

1 1. Methods and Techniques for developing Research projects A possible vision about Theories on the development and characterization of Scientific Research / Abstract of my Lectures Understanding about Science Scientific Methods and Techniques Writing scientific papers Evaluating scientific papers Consulting scientific Data Bases and searching for information ( Dr. Ana Azevedo) 2. Abstract of your Work Criticizing a scientific paper Organizing a workshop Writing a scientific paper Presenting a scientific paper 1

2 1.1 Basic Motivations: Issues on Scientific Methods Source: GETA and Graduate School of Electrical and Communications Engineering course: Introduction to Research Methodology, Aarne Mammela, VTT- Helsinki University of Technology, 2

3 Questioning Scientific Research Basic Characteristics: Cumulative versus reformulating always from the principles However: Thomas Kuhn (Harvard, Berkley, Princeton, MIT until ) The Structure of Scientific Revolutions He points out the role in scientific research of the emergence of NEW PARADIGMS. A PARADIGM is defined as: Scientific discoveries, which universally recognized during a certain period of time, create a new model for both problems and their respective solutions to be used by a community of practicians ans experimentalists Questioning Scientific Research Paradigms support theories based on concepts, phenomena and techniques for helping on explaining new facts or information. Science progresses through successive ruptures depending on the current accepted paradigms. Paradigms correspond to different views over the reality which are influenced by aspects other than scientific ones. Wittgenstein and duck-?????? L.Wittgenstein Tractatus Logico-Philosophicus Wttgeinstein s Poker, David Edmonds, J. Eidinow 3

4 Questioning Scientific Research Scientific interpretation (and perception) is mostly affected by Social as well as Psychological factors. Does it lead to Irrationality dominating Science? No! A good discussion on prevalence of science can be found in: Kuhn, T.S. Black-Body Theory and the Quantum Discontinuity, However: Paradigm change non-cumulative Science (sometimes) Example of important Paradigm changes: Solar System Ptolemy's vision changed by Copernicus vision Going from Newtonian Phisics to Quantic Physics (Uncertainty Versus Determinism..) and Relativity (Space- Time relationship). Questioning Scientific Research Karl Popper (London S. E., + 94) The Logic of Scientific Discover, Basic Books, 1959 (1ªEd Ing) Conjecture and Refutations, Harper & Row, 1968 Idealistic. He developed a Scientific Method as an Epistomology (a way of knowing ) independently of the intrinsic value. T. Khun e Feyerabend (1993) criticize this point of view showing how science is guided by value and, therefore being non-idealistic. This is a debate on Consciousness over Existence

5 Questioning Scientific Research Critical Rationalism proposal defends falsifiability as a criterion for demarcating (separating) science and non-science Induction Baaaad!!! - Falsifiability gooood!!! Popper argues that scientific theory will always be conjectural and provisional. It is not possible to confirm veracity (the truth) of a theory by means of simply recognizing that the results of a preview already done based on that very same theory, hold. That Theory should only be seen as a theory not (or not yet) contradicted by facts. Questioning Scientific Research Verificationism: a sentence should be either verifiable or falsifiable Critics addressed to Verificationism: Generalization: specific instances lead to universal assumptions bservation X, being an instance of Theory T creases the probability of Theory T being correct he Black Crow paradox : The Black Crow paradox : by Hempel: All Crows are Black" is logically equivalent to Everything which is Non-Black is not a Crow". x(cx Bx) x( Bx Cx) Thus, If x(cx Bx) reassures that x(cx Bx), Then x( Bx Cx) reassures that x( Bx Cx) which, being equivalent to x(cx Bx), this last implication would also see its probability of being True increased. MSR- MIC- Metodologias Methodologies de for Investigação Scientific Research Científica 5

6 Questioning Scientific Research Crítics addressed to Verificationism: Generalization: specific instances lead to universal assumptions There are Apples (non-crows) not Black Increases the probability that the sentence All Crows are Black is True If verificationism (generalization) was acceptable, any trivial evidence would support a Theory There are attempts to overcome this paradox.. falsifiability proposed by KP states that keeping just the Existential assertion permit us to know that if another existential proposition that contradicts it, arrises, this falsifies the Theory T!! Scientific Research 6

7 Scientific Research Exploration A An exploration Enterprise: Christopher Columbus the Explorer Motivation: ambiguous Problem: a new way to India Hypothesis: over the Atlantic and not around south Africa Experiment: Yes he have done it!! Conclusions:????? Scientific Research Exploration A research: discover new knowledge basic research (no specific application in mind) applied research (ideas into operational form) development: systematic use of the existing knowledge 7

8 Scientific Research Object A Science, Technology and Engineering [Jain97] science: organized or systematic body of knowledge technology: application of scientific knowledge for practical ends in engineering, medicine, agriculture, etc. natural sciences and engineering sciences differ in the object of study: natural sciences: objects in the nature engineering sciences: objects (products, services, methods) not found in the nature, using results of mathematics and natural sciences Scientific ResearchERS A Science, Technology and Engineering [Jain97] Verification, confirmation, and justification are synonymous terms in philosophy of science. The opposite is falsification or refutation. R. K. Jain and H. C. Triandis, Management of Research and Development Organizations: Managing the Unmanageable. John Wiley & Sons, Requirements for success You have to be: analytical and curious, autonomous and collaborative criticism and tolerant 8

9 Scientific ResearchERS A How does a researcher work? make always notes in a notebook make summaries on what has been learned. make plans for the future all the time (outlines, roadmaps) discuss, ask questions and argue (criticism) Scientific Research A Learning carefully by induction (bottom up, generalization from examples to models) [Felder88] Defending theories by deduction (top down, from models to results) Break the problem down and then generalize the results (divide and conquer) R. M. Felder and L. K. Silverman, Learning and teaching styles in engineering education, Engineering Education, pp , April

10 Scientific Research A 1.2 Supporting Theories Scientific Research Basic Characteristics Research involves Methodologie(s) and Techniques A- Methodology includes the study of several methods that are applicable to a class of problems i.e., the set of processes to conduct each specific Research Project B- Techniques refer to the means and specific Tools enabling relevant information acquisition, the respective data analysis, as well as the inferences that can be made. 10

11 Research Methods Dimensions A- Methodologies depending on the MOTIVATION: Pure Research : It contributes to a deep theoretical understanding and for a more abstract formulation of the phenomena. Instrumentalist Research : It contributes for making human intervention in Real world environments, more effective. Two major sub-categories are identified: Applied Research Problem - Oriented Research Research Methods Dimensions Apllied Research. Starting from a technology (devices, specific techniques, both) use them for dealing with processes (physic, organizational, social, individual,...) Problem- Oriented Research. Starting with the problem description and then looking for the adequated techniques to solve it. 11

12 Research Methods Dimensions Depending on the Theory underlying the Research: Descriptive, of all significative aspects of the domain Explicative, of the behaviour of all the phenomena Predictive of the future phenomena behaviour Prescriptive, beyond the prediction it should also prescribe and apply Norms and processes in identified specific circumstances (Research in IS, Electronics and Telecommunications should be of this kind) Research Methods Dimensions Depending on the tradition in that scientific area or Knowledge Domain: i) Traditional Scientific Research which is more quantitative ii) Interpretative Research which is more qualitative iii) Engineering-oriented Research iii) most appropriated for Electronics, Telecommunications and CS But do not ignore the other approaches! 12

13 Scientific Research Traditional Methods 1.3 Positivist (classical) Research method Scientific Research Traditional Methods Traditional Scientific Research is based on positivist rational thinking: From observations we may build up Theories trying to explain what has been observed Theories are expressed in Deductive form or using Axioms and Postulates which are then operated through Logics. 13

14 Scientific Research Traditional Methods Do Not Forget : Scientific Theories, following K. Popper, are capable of generating Inferences which are, in principle, falsifiable through references to the real world. Results coming from the process of testing hypothesis give feedback to the Theory, enabling verification of its trueness or detecting possible ab-normalities (T.Kuhn). Scientific Research Traditional Methods Whenever the Observation comes from the Real World it is called empirical and it becomes relevant in two situations: during the formation of the theoretical knowledge through the so-called passive observations during Hypothesis verification, gathering information in a more active way, although guided by that same theory. 14

15 Scientific Research Traditional Methods When we do not have a suitable Theory available, we have to pursue exploratory research where experiments and interpretation are open, not guided by a Theory and making available Empirical Knowledge that may postulate other Theories. IS and Telecommunications are disciplines (scientific areas) without a given stable theory. They encompass applied subjects using a partial theory or co-opting a theory from reference disciplines such as: Mathematics Information Theory (C.Shannon) Physics Theory of Organizations, Management Sciences, Computer Science. Scientific Research Traditional Methods 3 Theory of Disciplines of Reference 1 Real World 2 Theory Axioms Postulates Deductive Logic Hypothesis 4 Research Project Simulation 1- There exists a Real World that we can Perceive. 2- Knowledge is Organized in Theories making inferences possible 3- Applied Disciplines like IS or T rely on Theories of Reference of other Disciplines 4- A Research Project permits testing formal Hypothesis formulated through inferences expressed in the Theory. 5- In Empirical Research, Hypothesis derived from the Theory are directly cheked in the Real Worldl 6- Testing Hypothesis through Simulation 7- Results comming out of the Research give feedback to the Theory 15

16 Scientific Research Traditional Methods Summarizing: In traditional (or conventional) Science, new Hypothesis are extracted from the existent Theory, they are tested and new results are added to that Theory. Thus, it implies the pre-existance of: A theoretical Body of Knowledge An explicit theoretical Framework to guide the research Definition of what issues have to be investigated What are the explicit Hypotheses that could be refuted (falsifiability) Method for Applied Research and well defined techniques for testing the Hypothesis. Scientific Research Methods 1.4 Interpretative Research method is concerned with trying to understand lived experience and with how participants themselves make sense of their experiences. Therefore it is concerned with the meanings which those experiences hold for the participants. IRM is phenomenological in that it wishes to explore an individual s personal perception or account of an event or state as opposed to attempting to produce an objective record of the event or state itself. (Birkback- U. London) 16

17 Interpretative Approach to Scientific Research Interpretative Method (or philosophy): post-positivist criticizes the (conventional) scientific chimera declares the impossibility of objective observation Observations and Interpretations depend on the Observer. Addresses critics to both hard Sciences and Social Sciences, Difficulties for Objectivity: Interpretative Approach to Scientific Research Concepts, Factors, relationships that can t be accessed Researchers involvement in the research domain Results depending on the researcher own perspective: - On selecting and defining the research (sub-) domain - On selecting a pre-existant theory - On setting the issues to be investigated - On setting the precise scope of the research - On selecting and defining the Variables to be instantiated - On measuring those variables possible values Different attitudes on all those issues may lead to many different interpretations of the same observed phenomena. 17

18 Engineering-oriented Research Approach 1.5 Research in Engineering disciplines Engineering-oriented Research Approach For this approach to research, technology is very important! (devices, artefacts, practical techniques to be used) At least up to a certain extent is the most suitable for research in Information Systems, Electronics, Telecommunications. Research in IS and Telecomm is applied and problem-oriented. Implying: - application of suitable technology, - conceptualization: requirements, models - prototyping, - implementation - demonstration of (new) technology (real world/sim) - Evaluation phase 18

19 Engineering-oriented Research Approach Observation and Theory [Wohlin99] In engineering an hypothesis (defined in system specifications) is usually an idea of the relationship between the cause and effect (defined in system requirements) Theoretical model is always only an approximation of observation in real world C. Wohlin et al., Experimentation in Software Engineering: An Introduction, Springer, Engineering-oriented Research Approach In engineering we are fundamentally interested in how efficiently the basic resources are used for a needed performance. 19

20 Engineering-oriented Research Approach From Dr. Leung Yee Hong Australia TC Research Institut 20