Q. How is ‘consistency’ calculated?
Answer: The mental conundrum that people have with consistency scores is, “How can there be low consistency, ie. high variation, when the average scores are all relatively high?”. The explanation is actually quite simple. Basically, you can have a number of items where the scores are quite far apart, but the average still ends up being close to four.
Consider the small example below:
|Question||Score 1||Score 2||Average|
As you can see in this example, there is quite a large amount of variation in the scores, but the average is still four, which is relative high.
Also, the consistency score that is depicted in the reports is a benchmarked score, meaning that the graph is not depicting how consistent the scores are, but how consistent they are relative to the rest of the norm group. Basically, when we calculate benchmarks, we also calculate the consistency score for every single set of responses that is included in the norm group and then create a percentile map based on those scores, which is what we use to figure out the benchmarked score for consistency of responses for an individual report.
Q. Why isn’t the benchmark rectangle sitting above the “Average/Typical” label rather than the “More Than Others” label?
Answer: The rectangle that appears just above the “More Than Others” label indicates the range at which the middle 50% of participants have been rated. That is, the left hand edge of the rectangle represents the cut-off for the 25th percentile and the right hand edge of the rectangle represents the cut-off for the 75th percentile. This means that any score that results in a line that ends to the left of the rectangle was below the 25th percentile.
The reason is because most people overestimate the EQ of others, that is, most people see others as demonstrating EI behaviours better than average or typical, thus why the rectangle range tends to start around 3.5 and go through to 4.5. This is not just a phenomena of the Genos instrument: it’s a phenomena of all behaviour-based competency 360s, including other EI instruments. It’s also a phenomenon known to occur for IQ as well, although there are also cultural and gender differences in this area making it a very complex academic subject.
Having said all that, it doesn’t mean that people don’t get rated as demonstrating EI “Average” through to “Significantly Less than Others”. It’s just that only 25% of the population tend to get viewed that way.
Genos Surveys Administration
Q. Can I unlock an old survey?
Answer: This issue of unlocking old surveys is complicated and we usually don’t do it for the following reasons:
- First and foremost, an EI report should represent a snapshot in time. That is, the data collection window should ideally be as narrow as possible. In practice, a week or two is fine, but if a month of more has passed then it is not inconceivable that some event or interaction may have occurred that potentially skews the responses of the late rater(s) one way or the other.
- Rater privacy can be compromised if two versions of a report are provided to a participant, as it allows the participant to do a side by side comparison between the two reports and figure out what the incremental impact was of the late rater(s). Given that the participant often knows who the later rater(s) were, their confidentiality ends up being compromised as a result. As our entire business rests upon our ability to get people to respond to surveys on behalf of other people, maintaining our credibility by ensuring their privacy is paramount.
- The process itself can be logistically complicated, especially in larger surveys, as you need to ensure that all of the reports for which you do not want to collect further data are locked so that none of the outstanding raters for those groups is sent an email.
If we knew that people fully understood all of the nuances around unlocking older surveys then we would allow everybody to do it, but as many people are not very details-oriented and often prioritise the demands of their client over everything else, we currently feel that opening this ability up to the network could be harmful.
Q. Why can I download a report with a “Pending” status?
Answer: Genos reports, in particular Leadership 180 Reports, are often used as part of development programs or workshops and, in such cases, it is important that every participant attending the program has a report, as the contents of the report are often built into the program and, as such, the facilitator will most likely ask participants to refer to various pages in the report during the course of the workshop.
It is often the case that participants have not had enough time to get their report completed prior to the workshop. However, in such cases the participant still needs a report so that they can follow along in the program. Rather than provide them with a sample report that has “Sally Sample” on the front cover, it is preferable to provide them with a report that has their own name on the front cover. There are several reasons for this. Firstly, it means that the process of printing reports is much easier – all you need to do is download the report for each participant who will be attending, print it out and send it along, without worrying about how many sample reports you need to print for people who haven’t completed the survey process. It also means that handing out reports at the workshop is much more straightforward as there will be one report for each participant and each report will have the participant’s name on the front. This also avoids the awkwardness of handing out completed reports to some people and then having to hand out “Sally Sample” reports to whoever is left over.
Q. Will I be charged tokens if I download a report with a “Pending” status?
Answer: Yes, you will, in the sense that you will be unable to have the tokens for that participant refunded because a report will have already been downloaded for that participant. In essence, if a participant attends a workshop that has the Genos report built in, all participants in the program benefit from the Intellectual Property that is contained within the report, not just the participants who have completed reports. There is a great deal of information on the Genos model, the types of behaviours that underlie each dimension of the model and tips on how to obtain additional feedback. Although a participant with an incomplete report doesn’t obtain as much value from an incomplete report as a participant with a completed report, they still obtain some value. Finally, participants do not normally receive a discount on the course fees if they fail to get their report completed prior to the session. Instead, it is common practice to re-open the survey so that participants who had incomplete reports can finish the process.
Q. How do I know if I am downloading an incomplete report?
Answer: When reports are Pending, the “Download” link will be orange. This indicates that whilst the report can be downloaded, it will not contain any real data. The report will instead be generated with sample data.
Q. Can you advise at what point volume discounts apply and what the discount might be – Is it a flat rate or sliding scale?
Answer: Basically, for the self-managed service (administering your own surveys) a 20% discount automatically applies to the retail price of the reports.
Assessments are purchased by pre-purchasing tokens. Tokens can be used to run any assessment type in Genos Surveys and are deducted once participants are added. You can also qualify for higher discount tiers based on the amount you spend in a single purchase. So to receive a 30% discount, you will need to spend $5,000 or more. To receive a 40% discount you will need to spend $25,000 or more and 50% for $50,000 or more.
From the Member portal, Australian practitioners can pre-purchase tokens at any time if self-managing. This might be useful in showing you how it works. Additionally, you can see the pricing tiers in the 2018 pricing list.
Q. Does the Genos EI test need to be administered by Genos personnel?
Answer: For researcher purposes, there is no need to convert the raw scores into percentile scores. This would only be necessary for people that were going to debrief clients about their EI scores relative to others. Thus, you feel confident with following the instructions to score the Genos EI questionnaire as described in the document that you downloaded from our research webpage.
Q. Can I get a letter from Genos regarding permission to use the survey for research purposes?
Answer: The best way to proceed is for you to write out what you need to include in the permission letter (from Genos). Each university can be slightly different in this respect. Once you send us the content of the letter, it will be reviewed. Genos can then place the content on a document with a Genos letter-head and include a signature at the bottom of the permission letter.