Determining Validity of Research Framework

Organisation A

Project Manager

Best services for writing your paper according to Trustpilot

Premium Partner
From $18.00 per page
4,8 / 5
4,80
Writers Experience
4,80
Delivery
4,90
Support
4,70
Price
Recommended Service
From $13.90 per page
4,6 / 5
4,70
Writers Experience
4,70
Delivery
4,60
Support
4,60
Price
From $20.00 per page
4,5 / 5
4,80
Writers Experience
4,50
Delivery
4,40
Support
4,10
Price
* All Partners were chosen among 50+ writing services by our Customer Satisfaction Team

35

Quantity Surveyor

20

Building Surveyor

7

Organisation B

Quantity Surveyor

6

Project Manager

33

Organisation C

Cost Estimator

15

Project Manager

27

Construction Manager

7

Senior Lecturer

12

Senior Lecturer

30

Lecturer

6

Lecturer

7

Lecturer

25

Lecturer

25

Reader

31

Reader

21

Table 7.1: Characteristics of participating experts in the framework evaluation

Because the framework evaluation required a seminar presentation, this process was thought to be long, and it was expected a low rate of response. Therefore, it was decided to reach the target of participants by sending invites to a member of staff with the three case study organisations. The total number invitations forwarded was 300 of which 120 were sent to academics; and 180 to the three case study organisations.

7.4.2 Method of Evaluation

Emails was used a tool to invite experts and included;

An overview of the research project
Request to participate in the evaluation of the framework for the purpose of validity
Request on the best times which suits each of the case study organisation for a 40mins seminar presentation

The framework was presented to each case study organisation using Microsoft Office PowerPoint 2007. The presentation was interactive in which participants lessened the explanation; while diagram parts were moved in each presentation slides accordingly. The seminar presentation was arranged into ten slides which took a narrative sequence of logic since it began by clarifying the parts of the framework independently and afterwards presented the strategic framework.

Figure 7.1: A screenshot of the PowerPoint presentation

The questionnaire was designed and hosted using the online service provider: “Survey Monkey’ and consisted of two parts. Firstly, details about participants including name, organisation, job title, business and size of the organisation.

secondly, the framework evaluation and this was included in two sections

Score based questions to the rate the suitability and effectiveness of the developed framework
Seeking the opinions of the participants about the advantages, limitations and ways of improving the framework.

It was decided to present the framework diagrammatically showing the strategic, tactical and operational levels. The presentation gave a more in-depth description; however diagrams were sent to four research students to assess their readability, and the outcomes affirmed that such diagrams could convey the concept and details of the framework if the reader had extensive experience in construction management. One of the research students who took part in the pilot study was a medical doctor, dissociated from the construction industry, who found the framework unreadable, Although he has a good understanding of the major concept. Respondents were also sent an attachment of the presentations slides via email.

7.5 Results

7.5.1 Suitability of framework

Participants were being asked to show their rating for suitability for each of the components of the framework; where 1 implied unsuitable and 5 suitable. The answer from the analysis uncovered that the levels of suitability for all approaches were considered far above the ground.

As shown in Table 7.2, 3.74 out of 5 is the lowest mean value for the architecture of the knowledge base. Although it is not indicated in the value that the architecture of knowledge base is a 100% suitable, rather, it shows that it is likely going to be more suitable than unsuitable. The circumstance with regards to knowledge capture, retrieval and structure approach much better as they all have a score of 4 out of 5. The skewness measure has a negative value which shows that the mass of distribution concentrates on the side of suitable.

Knowledge Capture

Knowledge retrieval

Knowledge Structure

Architecture of Knowledge Base

N

Valid

16

16

16

16

Missing

0

0

0

0

Mean

3.9375

4.0625

4.0000

3.7500

Std. Deviation

.85391

.85391

.89443

1.00000

Skewness

-.605

-.863

-.639

-.343

Table 7.2: Suitability of the framework components

Figure 7.2 shows that the majority of the participants gave a 4 or 5 rating of the suitability of all the framework components. With regards to the architecture of the knowledge base, the suitability was rated under 3 by two participants (i.e. 2). The normal curve illustrates that the approximation of the average of all components almost falls in the 4 rate of suitability. All the indications provide evidence that those components are suitable for the construction organisations.

7.5.2 Effectiveness of framework

Participants were being asked to show their rating for effectiveness for each of the components of the framework; where 1 implied to be ineffective and 5 effective. The mean value of effectiveness for all components as shown is (Table 7.3) are above 3.75 and ranges between 3.87 and 4.18. The skewness measure has a negative value which shows that the mass of the distribution is concentrated on the side of effectiveness.

Knowledge Capture

Knowledge Retrieval

Knowledge Structure

Architecture of Knowledge Base

N

Valid

16

16

15

16

Missing

0

0

1

0

Mean

4.0625

4.18750

3.9333

3.8750

Std. Deviation

.85391

.910586

.79881

1.02470

Skewness

-.863

-1.019

-.842

-.571

Table 7.3: Effectiveness of the framework components

As shown on the histograms shown in Figure 7.3 shows that the majority of experts participants evaluated all components to a score 4 or 5 rates of effectiveness. Knowledge retrieval thus turns out slightly more effective than the other framework components. The normal curve makes it clear the approximation of the average rate of all components which almost lies in the 4 rate of effectiveness. All the indicators together provide evidence that those components will be effective when implemented.

7.5.3 The Entire Framework Suitability

Experts participants were asked to indicate their rate of suitability for the entire framework using the same criteria as mentioned above. As shown in Table 7.4, the mean value of suitability (3.93) and the negative value of the skewness measure provide an encouraging indication for the external validity. In Figure 7.5, the pie chart shows that the majority of experts participants (62%) rate the suitability 4 out of 5; and the vast majority (81.3%) are either giving the framework a rate of 5 or 4. Furthermore, the histogram in Figure 7.4 shows that only one expert gave a rating of suitability under 3 (i.e. 2). Therefore, the indications of suitability are positive and show that this framework is considered suitable.

The Entire Framework Suitability

N

Valid

16

Missing

0

Mean

3.9375

Std. Deviation

.77190

Skewness

-.881

Table 7.4: The entire framework suitability

7.5.4 Effectiveness of the Entire Framework

Expert participants were asked to indicate their rate of effectiveness for the entire framework using the same criteria as mentioned above. The mean value (4) and the skewness measure value (negative) which shows that the framework is evaluated to be effective as shown in Table 7.5. A third of the expert’s participant shows a full mark of effectiveness, and 40% scored the framework a rate of 4 for effectiveness as shown in Figure 7.7. However, as shown in Figure 7.6, three experts rate it a 3 and one a 2. Nonetheless, the normal curve is pointing to an approximation of effectiveness at the rate of 4. Indications show that the framework is effective.

Effectiveness of the Entire Framework

N

Valid

15

Missing

1

Mean

4.0000

Std. Deviation

.92582

Skewness

-.623

Table 7.5: Effectiveness of the entire framework.

7.5.5 Experts Opinion about the Framework

The expert participants were requested to express their opinion about the framework regarding suitability, effectiveness, advantages and limitations. This could give additional assessment not covered in the closed-ended questions. Twelve of the feedbacks were received and had been listed below:

It looks good to me. The problem is getting it work in practice.
Great model and l like it, particularly the knowledge forms and the categorisation. This will help save time when searching for knowledge
I think the overall seminar presentation was good and it covered a lot of the things we do not consider as worth pointing out in our day to day project delivery implementation.
It is very hard to make a judgment on these key issues just on the presentation. However, I am quite inspired by the approach to knowledge capture. Although the presentation is great, however, the information, it provides is insufficient.
It seems very general.
The framework works well in suitability and effectiveness; and in use of collaboration tools, intranet tools with knowledge management within organisations. It is essential for a large organisation that staff can find and utilise answers as well as gaining access to the subject matter, experts and sharing information on similar projects and programmes. The advantages are that knowledge is shared rather than lost or protected by individuals. The saying that knowledge is power is true of individuals; However in organisations that are able and willing to capture knowledge and share this with the wider team rather than isolating it with individual project members.
The framework is suitable and effective in many areas and an insightful and logical structure. There is some duplication, but that would seem to be unavoidable.
Leadership support is important, with top-bottom commitment. Co-operation/sharing is not always a “natural” inclination in individuals.
The framework seems to be highly advanced and would require an IT system to enhance its processes and to encourage people to use it. If all members of the organisation are contributing positively to the framework; and most of them have the ability to capture, retrieve, and then re-use the captured knowledge, then the system will be for sure highly effective. In reality, I think we share the knowledge “sometimes”, but even when we do so, we do not document or capture them properly. As a result, we lose whatever we have shared as we cannot capture, structure and re-use all the knowledge captured by only relying on our brain capabilities. We as practitioners need such a framework to assist us to have a better understanding of the knowledge so we can use it appropriately. From an overall point of view, I admire you for this excellent presentation, and it was informative and well structured. We have learned a lot from this insightful presentation about knowledge management. There is no doubt that this framework is needed for business success.
Although the framework appears to be complicated on its operational side; I am certain that if the KM operation depends on this model, the result will be relevant and highly efficient.
The framework makes sense from a project management perspective. However, knowledge capture and retrieval are complex and resource intensive activities and can be onerous to the project team if proper incentives are not aligned with the leadership’s expectation of knowledge sharing.
I think if your framework is properly applied, it will be extremely effective. Also, it is highly suitable. Regarding its advantages, I think it is simple to read and understand by any person who has a basic level of knowledge management and its management.

The issues mentioned in the comments can be grouped into four categories: Firstly, those which highlight the role of knowledge capture and retrieval.

Secondly, those who stress the importance and need for such a framework, due to the awareness of the problem, and thus confirm the motives for this research.

Thirdly, indications that the framework may require a huge effort and construction projects already involved in demanding work. This issue has been discussed in the statement of the problem (section 1.4) whereby the problem lies on the capture and not the retrieval side. To minimise the problem, the project review was adopted as the main technique for knowledge capture which already exists in projects, rather than introducing a new approach. Additionally, the daily based reviews were rejected in this research for the same reason. Furthermore, a strategy for motivation has been pinpointed in the framework to ensure the application of knowledge capture.

Fourthly and most importantly, a suitable and effective framework will also require careful application and effort. This has been said by several experts, and therefore considered a critical point, because the good theory does not necessary guarantee successful application.

Finally, an expert described the framework to be very general. As aIn fact the framework is considering a particular area to investigate, related to knowledge capture and retrieval of project management processes, in the context of the project. Models inside the framework have provided precise details regarding what to do in particular scenarios. Also, knowledge capture and retrieval cannot be tackled in isolation from issues such as.

Leadership support and cooperative culture. It is worth mentioning that this expert selected the rating of 2 for all of the 10 rating-based questions which are considered statistically biased. However, it was thought that this academic expert provided his personal details and these matched the tracking information. Therefore it was considered a valid response, and his opinion was appreciated.

The answers can be categorised into four major groups:

You Might Also Like
x

Hi!
I'm Alejandro!

Would you like to get a custom essay? How about receiving a customized one?

Check it out