How to find the number of top columns and columns which contains all zero's in a file?

Karthik Agarwal

14y4.6k

I have something typical to do, and i am not sure how do that. Can someone help me out this!!!

I have data as follows from which what i should be doing in this is, if you observe the data closely top 2 lines of the data are all zero's and the bottom three lines are all zero's. This is what i need to find from the data. Suppose in this case the number of lines of data i have is 8 of which top 2 lines and bottom 3 lines are empty. I need to find the exact number of lines and the number of lines which contains all zero's in a line till it find some non zero value. Similar work should be done in the bottom of the data. Suppose if 4th line of the data below is all zero's i don't need that bcoz still there is data left over.

static DATA_T const lc38[]=
{
0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0xA0,0x4F,0x00
,0x00,0x40,0xAF,0x00
,0x00,0x00,0xFA,0x05
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
};

I know it's weird but what can i do, i have find it some how.
Note: There could be N number of rows and columns. And there could be N number of data's like this in a single file. I need a output file with the total number of rows and the how many top columns empty and how many bottom columns empty.

For any further clarification please post back.

10 Replies

Know the answer? Post it — somebody with the same question will find it here.

Vulpes14y ago
Accepted answer
Rather than disrupt the CountEmptyLines function, I've added another global function:

List^ GetIdentifiers(array^ lines)
{
System::Text::RegularExpressions::Regex^ reg = gcnew System::Text::RegularExpressions::Regex("\\d+");
List^ identifiers = gcnew List();

for each(String^ line in lines)
{
if(line->StartsWith("static"))
{
identifiers->Add(Int32::Parse(reg->Match(line)->Value));
}
}

return identifiers;
}

and changed the main() function as follows:

int main(array ^args)
{
String^ filePath = "D:\\Karthik\\Font_Issue\\new\\Copy of HeiS_Ford_AL_23.txt";

array^ lines = File::ReadAllLines(filePath);
List^ identifiers = GetIdentifiers(lines);
List^ topLines = CountEmptyLines(lines, false);
List^ bottomLines = CountEmptyLines(lines, true);

StreamWriter ^ sw = gcnew StreamWriter("D:\\Karthik\\new\\new_total_count_details.txt");

for(int i = 0; i < topLines->Count; i++)
{
sw->WriteLine(String::Format("Identifier {0}, top = {1}, bottom = {2}", identifiers[i], topLines[i], bottomLines[i]));
}

sw->Close();
return 0;
}
0
Karthik Agarwal14y ago
great work Vulpes. This working as it is.
0
Karthik Agarwal14y ago
Great this is working very fine, but i just want to add something into this. As i have huge data, it would be nice if the identifier is beside that it self.

like follows:
Identifier 38, top = 8, bottom = 10

38 came from the line static DATA_T const lc38[]=
0
Vulpes14y ago
OK, see if this will now do what you want:

#include "stdafx.h"

using namespace System;
using namespace System::IO;
using namespace System::Collections::Generic;

List^ CountEmptyLines(array^ lines, bool inReverse)
{
List^ zeroCount = gcnew List();
array^ trimChars = {' ', ','};
bool isCounting = false;
bool allZero = false;
int count = 0;
wchar_t startChar, endChar;

if(inReverse)
{
Array::Reverse(lines);
startChar = '}';
endChar = '{';
}
else
{
startChar = '{';
endChar = '}';
}

for each(String^ line in lines)
{
if (line->Length == 0)
{
continue;
}
else if (line[0] == startChar)
{
isCounting = true;
count = 0;
}
else if (line[0] == endChar)
{
if (inReverse && isCounting)
{
zeroCount->Add(0); // already counted in top lines
}
else
{
zeroCount->Add(count);
}

isCounting = false;
}
else if (isCounting)
{
array^ items = line->TrimStart(trimChars)->Split(',');
allZero = true;

for each(String^ item in items)
{
if (item != "0x00")
{
allZero = false;
break;
}
}

if(!allZero)
{
isCounting = false;
}
else
{
count++;
}
}
}

if(inReverse)
{
Array::Reverse(lines);
zeroCount->Reverse();
}

return zeroCount;
}

int main(array ^args)
{
String^ filePath = "D:\\Karthik\\Font_Issue\\new\\Copy of HeiS_Ford_AL_23.txt";

array^ lines = File::ReadAllLines(filePath);
List^ topLines = CountEmptyLines(lines, false);
List^ bottomLines = CountEmptyLines(lines, true);

StreamWriter ^ sw = gcnew StreamWriter("D:\\Karthik\\new\\new_total_count_details.txt");

for(int i = 0; i < topLines->Count; i++)
{
sw->WriteLine(String::Format("top = {0}, bottom = {1}", topLines[i], bottomLines[i]));
}

sw->Close();
return 0;
}
0
Karthik Agarwal14y ago
Yes i have the data exactly as follows:
static DATA_T const lc38[]=
{
0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0xA0,0x4F,0x00
,0x00,0x40,0xAF,0x00
,0x00,0x00,0xFA,0x05
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
};

static DATA_T const lc39[]=
{
0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x10,0x40,0x00
,0x00,0x40,0xAF,0x00
,0x00,0x00,0x00,0x06
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
};

0
Vulpes14y ago
The reason why you're getting the number of zero lines in between, as well as at the top and the bottom, is because you're not making any attempt to identify the different batches.

In order to correct it, I need to be clear what the file contains.

Does it contain stuff exactly like this:

static DATA_T const lc38[]=
{
0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0xA0,0x4F,0x00
,0x00,0x40,0xAF,0x00
,0x00,0x00,0xFA,0x05
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
};

static DATA_T const lc39[]=
{
0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x10,0x40,0x00
,0x00,0x40,0xAF,0x00
,0x00,0x00,0x00,0x06
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
};

or does it contain just the data within those arrays (including the leading commas):

0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0xA0,0x4F,0x00
,0x00,0x40,0xAF,0x00
,0x00,0x00,0xFA,0x05
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00

0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x10,0x40,0x00
,0x00,0x40,0xAF,0x00
,0x00,0x00,0x00,0x06
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00

If it's the latter is there a blank line between batches as I've shown?
0
Karthik Agarwal14y ago
This is what i have done, i am very close hence can you correct me where i went wrong.

// Font_Issue1.cpp : Defines the entry point for the console application.
//

int main(array ^args)
{
   String^ filePath = "D:\\Karthik\\Font_Issue\\new\\Copy of HeiS_Ford_AL_23.txt";
StreamWriter ^ sw = gcnew StreamWriter("D:\\Karthik\\new\\new_total_count_details.txt");//Top codes
   array^ lines = File::ReadAllLines(filePath);
int top_count = 0;
bool all_zeros = true;
int final_count = 0;
String ^ end = "";
String ^ final_end = "";
bool temp = true;
bool final_temp = true;
for each(String^ line in lines)
{
all_zeros = true;
array^ top_codes = line->Split(',');
for each(String^ top_code in top_codes)
{
if(!((top_code->Contains("0x00")) || (top_code->Contains(" ")) ||
(top_code->Contains("0x00"))))
{
all_zeros = false;
}
end = top_code;
}

if(all_zeros)
{
top_count++;
if(temp)
{
final_count = top_count;
}
}

if(temp)
{
if(!all_zeros)
{
top_count = 0;
sw->Write(final_count + "\r\n");
final_count = 0;
}
}
temp = all_zeros;
}
sw->Flush();
sw->Close();
   return 0;
}
This code is giving me the all the counts i.e number of all zero lines in the top of the data, number of all zero lines in the bottom and also in between as well. If i just get the top and bottom data which is enough for me. Some where i went wrong, do correct me.
0
Karthik Agarwal14y ago
The code you have provided doesn't meet my requirement as when the line is split in to items the very 1st line of the data doesn't start with comma where the second line of the data start withs comma hence when it is split into items the 1st item would be space. therefore the allzero will definitely become false and everything will go false.

Apart from that this code will not search for several batches in the file but it does the job only once and it will exit the search. This is not what i want i have several batches of data as i said before. If it is only small number of batches i would have counted on my own. If i am writing code you should be able to understand how many batches of those i have. For that reason i was asking the output should be written in an output file so i can have a look into that clearly. if its console window that's tough to analyze.

That too i need this ASAP.
0
Karthik Agarwal14y ago
there will be similar kind of block as i have shown above.

static DATA_T const lc38[]=
{
0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0xA0,0x4F,0x00
,0x00,0x40,0xAF,0x00
,0x00,0x00,0xFA,0x05
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
};

static DATA_T const lc39[]=
{
0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x10,0x40,0x00
,0x00,0x40,0xAF,0x00
,0x00,0x00,0x00,0x06
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
,0x00,0x00,0x00,0x00
};

and so on..... I hope this is what your doubt is!
Anyway i would try out this and will update you the status.
0
Vulpes14y ago
This C++/CLI code should deal with a file containing one batch of data similar to what you have in your array:

#include "stdafx.h"

using namespace System;
using namespace System::IO;

int CountEmptyLines(array^ lines)
{
int count = 0;
for each(String^ line in lines)
{
array^ items = line->Split(',');
bool allZero = true;
for each(String^ item in items)
{
if (item != "0x00")
{
allZero = false;
break;
}
}
if(!allZero) break;
count++;
}

return count;
}

int main(array ^args)
{
String^ filePath = "d:\\foxsoft\\cs3\\karthik.txt";
array^ lines = File::ReadAllLines(filePath);
int top = CountEmptyLines(lines);
Array::Reverse(lines);
int bottom = CountEmptyLines(lines);
Console::WriteLine("Empty lines at top = {0}, bottom = {1}", top, bottom);
Console::ReadKey();
return 0;
}

However, you mentioned that there could be several such batches in the one file. If so, how would one batch be separated from the next?
0